Jul 05 18:09:57 devstack cinder-volume[75393]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 18:09:57 devstack cinder-volume[75393]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 18:09:57 devstack cinder-volume[75393]: we strongly recommend against using it for new projects. Jul 05 18:09:57 devstack cinder-volume[75393]: If you are already using Eventlet, we recommend migrating to a different Jul 05 18:09:57 devstack cinder-volume[75393]: framework. For more detail see Jul 05 18:09:57 devstack cinder-volume[75393]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 18:09:57 devstack cinder-volume[75393]: import eventlet # noqa Jul 05 18:10:00 devstack cinder-volume[75393]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 18:10:00 devstack cinder-volume[75393]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 18:10:00 devstack cinder-volume[75393]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 18:10:01 devstack cinder-volume[75393]: INFO dbcounter [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Registered counter for database cinder Jul 05 18:10:01 devstack cinder-volume[75393]: DEBUG oslo_db.sqlalchemy.engines [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75393) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:10:01 devstack cinder-volume[75393]: DEBUG dbcounter [-] [75393] Writer thread running {{(pid=75393) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 18:10:01 devstack cinder-volume[75393]: INFO cinder.rpc [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 18:10:01 devstack cinder-volume[75393]: INFO cinder.rpc [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 18:10:01 devstack cinder-volume[75393]: DEBUG oslo_db.sqlalchemy.engines [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75393) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:10:01 devstack cinder-volume[75393]: INFO cinder.volume.manager [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Determined volume DB was empty at startup. Jul 05 18:10:01 devstack cinder-volume[75393]: DEBUG cinder.volume.manager [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75393) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 18:10:01 devstack cinder-volume[75393]: INFO cinder.volume.manager [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 18:10:01 devstack cinder-volume[75393]: WARNING stevedore.named [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 18:10:01 devstack cinder-volume[75393]: WARNING castellan.key_manager [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 18:10:01 devstack cinder-volume[75393]: WARNING cinder.keymgr.conf_key_mgr [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 18:10:01 devstack cinder-volume[75393]: DEBUG cinder.volume.drivers.lvm [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75393) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 05 18:10:01 devstack cinder-volume[75393]: DEBUG oslo_concurrency.processutils [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_concurrency.processutils [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] CMD "cinder-rtstool verify" returned: 0 in 0.602s {{(pid=75393) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_db.sqlalchemy.engines [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75393) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:10:02 devstack cinder-volume[75393]: INFO cinder.rpc [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 05 18:10:02 devstack cinder-volume[75393]: INFO cinder.rpc [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 05 18:10:02 devstack cinder-volume[75393]: WARNING stevedore.named [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 18:10:02 devstack cinder-volume[75393]: WARNING castellan.key_manager [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 18:10:02 devstack cinder-volume[75393]: INFO cinder.volume.manager [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_db.sqlalchemy.engines [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75393) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:10:02 devstack cinder-volume[75393]: INFO oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Starting 1 workers Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Started child 75572 {{(pid=75393) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Full set of CONF: {{(pid=75393) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] ******************************************************************************** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Configuration options gathered from: {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] ================================================================================ {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] allow_availability_zone_fallback = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75572]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] allow_compression_on_image_upload = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] allowed_direct_url_schemes = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] api_rate_limit = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] auth_strategy = keystone {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] az_cache_duration = 3600 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_availability_zone = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_host = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_stats_polling_interval = 60 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backup_api_class = cinder.backup.api.API {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backup_name_template = backup-%s {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backup_use_same_host = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backup_use_temp_snapshot = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] chap_password = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] chap_username = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cinder_internal_tenant_project_id = df547620793140078f26daa368a4cd15 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cinder_internal_tenant_user_id = 59f135736dc1450ea30115c8066a83f9 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cloned_volume_same_az = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cluster = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] compression_format = gzip {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] compute_api_class = cinder.compute.nova.API {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] config_dir = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] config_source = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] control_exchange = openstack {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] debug = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] default_availability_zone = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] default_group_type = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] default_volume_type = lvmdriver-1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] disk_geometry = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] driver_client_cert = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] driver_client_cert_key = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] driver_data_namespace = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] driver_ssl_cert_path = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] driver_ssl_cert_verify = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] driver_use_ssl = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] enable_force_upload = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] enable_new_services = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] enable_unsupported_driver = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] enabled_backends = ['lvmdriver-1'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] enforce_multipath_for_image_xfer = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] filter_function = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_api_insecure = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_api_servers = ['http://192.168.122.122/image'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_api_ssl_compression = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_ca_certificates_file = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_catalog_info = image:glance:publicURL {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75572]: INFO cinder.volume.manager [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_certfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_keyfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_num_retries = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance_request_timeout = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] goodness_function = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] graceful_shutdown_timeout = 5 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] group_api_class = cinder.group.api.API {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] host = devstack {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_compress_on_upload = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_conversion_address_space_limit = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_conversion_cpu_limit = 60 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_conversion_disable = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_upload_use_cinder_backend = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_upload_use_internal_tenant = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_volume_cache_enabled = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_volume_cache_max_count = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] image_volume_cache_max_size_gb = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] init_host_max_objects_retrieval = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] instance_format = [instance: %(uuid)s] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] iscsi_target_flags = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] iscsi_write_cache = on {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] iser_helper = tgtadm {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] iser_ip_address = 192.168.122.122 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] iser_port = 3260 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] log_color = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] log_config_append = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] log_dir = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] log_file = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] log_options = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] log_rotate_interval = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] log_rotate_interval_type = days {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] log_rotation_type = none {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] max_age = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] max_logfile_count = 30 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] max_logfile_size_mb = 200 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] max_over_subscription_ratio = 20.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] message_reap_interval = 86400 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] message_ttl = 2592000 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] migration_create_volume_timeout_secs = 300 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] monkey_patch = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] monkey_patch_modules = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] my_ip = 192.168.122.122 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] no_snapshot_gb_quota = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] num_iser_scan_tries = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] num_shell_tries = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] num_volume_device_scan_tries = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] nvmeof_conn_info_version = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] nvmet_ns_id = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] nvmet_port_id = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] osapi_max_limit = 1000 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] osapi_volume_ext_list = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] osapi_volume_listen = 0.0.0.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] osapi_volume_listen_port = 8776 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] osapi_volume_use_ssl = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] osapi_volume_workers = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] per_volume_size_limit = -1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] periodic_fuzzy_delay = 60 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] periodic_interval = 60 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] project_id_regex = [0-9a-f\-]+ {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] public_endpoint = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] publish_errors = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] quota_backup_gigabytes = 1000 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] quota_backups = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] quota_gigabytes = 1000 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] quota_groups = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] quota_snapshots = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] quota_volumes = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] rate_limit_burst = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] rate_limit_except_level = CRITICAL {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] rate_limit_interval = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] reinit_driver_count = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] replication_device = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] report_discard_supported = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] report_interval = 120 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] reservation_clean_interval = 86400 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] reservation_expire = 86400 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] reserved_image_namespaces = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] reserved_percentage = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] rpc_response_timeout = 120 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] run_external_periodic_tasks = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] scst_target_driver = iscsi {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] scst_target_iqn_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_down_time = 720 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] shell_completion = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] snapshot_name_template = snapshot-%s {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] snapshot_same_host = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] split_loggers = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] state_path = /opt/stack/data/cinder {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:02 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] storage_availability_zone = nova {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] storage_protocol = iSCSI {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] syslog_log_facility = LOG_USER {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] target_helper = lioadm {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] target_ip_address = 192.168.122.122 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] target_port = 3260 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] target_protocol = iscsi {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] target_secondary_ip_addresses = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] trace_flags = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] transfer_api_class = cinder.transfer.api.API {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] transport_url = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] until_refresh = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] use_chap_auth = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] use_default_quota_class = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] use_journal = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] use_json = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] use_multipath_for_image_xfer = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] use_stderr = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] use_syslog = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] verify_glance_signatures = enabled {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_api_class = cinder.volume.api.API {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_backend_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_clear = zero {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_clear_ionice = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_clear_size = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_copy_bps_limit = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_dd_blocksize = 1M {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_name_template = volume-%s {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_service_inithost_offload = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volume_usage_audit_period = month {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] zoning_mode = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_concurrency.disable_process_locking = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack sudo[75576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack sudo[75576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.auth_section = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.auth_type = password {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.auth_version = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.cache = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.certfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.delay_auth_decision = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.http_connect_timeout = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.include_service_catalog = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.insecure = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.interface = public {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.keyfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_password = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcache_username = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.region_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.service_token_roles_required = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.service_type = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.token_cache_time = 300 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.122/identity {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.backend = dogpile.cache.null {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.backend_argument = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.backend_expiration_time = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.config_prefix = cache.oslo {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.debug_cache_backend = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.enable_retry_client = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.enable_socket_keepalive = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.enabled = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.expiration_time = 600 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.hashclient_retry_attempts = 2 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.memcache_dead_retry = 300 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.memcache_pool_maxsize = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.memcache_sasl_enabled = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.password = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.proxies = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.redis_db = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.redis_sentinel_service_name = mymaster {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.redis_server = localhost:6379 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.retry_attempts = 2 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.retry_delay = 0.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.socket_keepalive_count = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.socket_keepalive_idle = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.socket_keepalive_interval = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.socket_timeout = 1.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.tls_allowed_ciphers = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.tls_cafile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.tls_certfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.tls_enabled = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.tls_keyfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cache.username = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] coordination.backend_url = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.asyncio_connection = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.asyncio_slave_connection = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.backend = sqlalchemy {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.connection = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.connection_debug = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.connection_parameters = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.connection_recycle_time = 3600 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.connection_trace = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.db_inc_retry_interval = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.db_max_retries = 20 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.db_max_retry_interval = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.db_retry_interval = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.max_overflow = 50 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.max_pool_size = 5 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.max_retries = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.mysql_wsrep_sync_wait = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.pool_timeout = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.retry_interval = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.slave_connection = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.sqlite_synchronous = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.synchronous_reader = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] database.use_db_reconnect = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.connection_string = messaging:// {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.enabled = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.es_doc_type = notification {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.es_scroll_size = 10000 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.es_scroll_time = 2m {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.filter_error_trace = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.hmac_keys = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.sentinel_service_name = mymaster {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.socket_timeout = 0.1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.trace_requests = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler.trace_sqlalchemy = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler_jaeger.process_tags = {} {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler_jaeger.service_name_prefix = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] profiler_otlp.service_name_prefix = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.enforce_new_defaults = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.enforce_scope = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.policy_default_rule = default {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.policy_file = policy.yaml {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_policy.remote_timeout = 60.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] privsep_osbrick.group = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] privsep_osbrick.helper_command = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] privsep_osbrick.user = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cinder_sys_admin.group = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cinder_sys_admin.helper_command = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] cinder_sys_admin.user = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.auth_section = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.auth_type = password {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.cafile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.certfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.collect_timing = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.insecure = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.keyfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.send_service_user_token = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.split_loggers = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] service_user.timeout = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.auth_section = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.auth_type = password {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.certfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.collect_timing = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.insecure = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.keyfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.region_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.split_loggers = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] glance.timeout = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.backend_availability_zone = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.chap_password = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.chap_username = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.disk_geometry = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.driver_client_cert = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.driver_client_cert_key = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.driver_data_namespace = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.driver_use_ssl = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.enable_unsupported_driver = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.extra_capabilities = {} {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.filter_function = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.goodness_function = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.iscsi_target_flags = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.iscsi_write_cache = on {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.iser_helper = tgtadm {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.iser_ip_address = 192.168.122.122 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.iser_port = 3260 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.lvm_mirrors = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.lvm_share_target = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.lvm_type = auto {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.num_shell_tries = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.nvmet_port_id = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.replication_device = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.report_discard_supported = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.reserved_percentage = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.scst_target_driver = iscsi {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.scst_target_iqn_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.storage_protocol = iSCSI {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.target_helper = tgtadm {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.target_ip_address = 192.168.122.122 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.target_port = 3260 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.target_protocol = iscsi {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.trace_flags = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.unique_fqdn_network = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.use_chap_auth = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volume_backend_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volume_clear = zero {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volume_clear_ionice = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volume_clear_size = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volume_group = cinder-volumes {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_reports.file_event_handler = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_reports.log_dir = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.backend_availability_zone = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.backend_host = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.chap_password = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.chap_username = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.chiscsi_conf = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.disk_geometry = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.driver_client_cert = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.driver_data_namespace = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.driver_use_ssl = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.extra_capabilities = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.filter_function = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.goodness_function = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.iser_helper = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.iser_ip_address = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.iser_port = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.iser_target_prefix = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.lvm_conf_file = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.lvm_mirrors = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.lvm_share_target = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.lvm_type = auto {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.num_shell_tries = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.nvmet_port_id = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.replication_device = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.report_discard_supported = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.reserved_percentage = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.scst_target_driver = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.storage_protocol = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.target_helper = lioadm {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.target_ip_address = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.target_port = 3260 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.target_protocol = iscsi {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.trace_flags = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.use_chap_auth = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volume_clear = zero {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volume_clear_size = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] lvmdriver-1.volumes_dir = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.ssl = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.ssl_version = {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_notifications.driver = [] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_notifications.retry = -1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] oslo_messaging_notifications.transport_url = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] key_manager.fixed_key = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.barbican_api_version = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.barbican_endpoint = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.barbican_endpoint_type = public {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.barbican_region_name = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.cafile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.certfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.collect_timing = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.insecure = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.keyfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.number_of_retries = 60 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.retry_delay = 1 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.send_service_user_token = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.split_loggers = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.timeout = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.verify_ssl = True {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican.verify_ssl_path = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican_service_user.auth_section = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican_service_user.auth_type = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican_service_user.cafile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican_service_user.certfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican_service_user.collect_timing = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican_service_user.insecure = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican_service_user.keyfile = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican_service_user.split_loggers = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] barbican_service_user.timeout = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.approle_role_id = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.approle_secret_id = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.kv_mountpoint = secret {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.kv_path = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.kv_version = 2 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.namespace = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.root_token_id = **** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.ssl_ca_crt_file = None {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.timeout = 60.0 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.use_ssl = False {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:10:02 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] ******************************************************************************** {{(pid=75393) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 18:10:03 devstack sudo[75576]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:03 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:03 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:03 devstack sudo[75748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:10:03 devstack sudo[75748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:04 devstack sudo[75748]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:04 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.700s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:04 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:10:04 devstack cinder-volume[75572]: INFO cinder.brick.local_dev.lvm [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 05 18:10:04 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:04 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:04 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:04 devstack sudo[75966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:10:04 devstack sudo[75966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:04 devstack sudo[75966]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:04 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:04 devstack cinder-volume[75572]: DEBUG cinder.brick.local_dev.lvm [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75572) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 05 18:10:04 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:04 devstack sudo[76139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:10:04 devstack sudo[76139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:05 devstack sudo[76139]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:05 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.117s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:05 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:05 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:05 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:06 devstack sudo[76347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:10:06 devstack sudo[76347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:06 devstack sudo[76347]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:06 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.773s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:06 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:06 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:06 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:06 devstack sudo[76353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 05 18:10:06 devstack sudo[76353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:07 devstack sudo[76353]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:07 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.722s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:07 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:07 devstack sudo[76357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:10:07 devstack sudo[76357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:08 devstack sudo[76357]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:08 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.782s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:08 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:08 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:10:08 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:09 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:09 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.768s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:09 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:09 devstack sudo[76374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:10:09 devstack sudo[76374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:09 devstack sudo[76374]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:09 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.782s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:09 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:09 devstack sudo[76379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:10:09 devstack sudo[76379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:10 devstack sudo[76379]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:10 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.796s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:10 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:10 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:10 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:10 devstack sudo[76388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:10:10 devstack sudo[76388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:11 devstack sudo[76388]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:11 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:11 devstack cinder-volume[75572]: INFO cinder.volume.drivers.lvm [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 05 18:10:11 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:11 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:11 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:11 devstack sudo[76397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:10:11 devstack sudo[76397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:12 devstack sudo[76397]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:12 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.724s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:12 devstack cinder-volume[75572]: DEBUG cinder.volume.drivers.lvm [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Updating volume stats {{(pid=75572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 18:10:12 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:12 devstack sudo[76512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:10:12 devstack sudo[76512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:12 devstack cinder-volume[75393]: DEBUG dbcounter [-] [75393] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75393) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:10:12 devstack sudo[76512]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:12 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:12 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:12 devstack sudo[76658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:10:12 devstack sudo[76658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:13 devstack sudo[76658]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:13 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:13 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:13 devstack sudo[76661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:10:13 devstack sudo[76661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:14 devstack sudo[76661]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:14 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:14 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:14 devstack sudo[76664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:10:14 devstack sudo[76664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:14 devstack sudo[76664]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:14 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:14 devstack cinder-volume[75572]: INFO cinder.volume.driver [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 18:10:14 devstack cinder-volume[75572]: DEBUG cinder.volume.driver [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75572) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 18:10:14 devstack cinder-volume[75572]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:10:14 devstack cinder-volume[75572]: DEBUG dbcounter [-] [75572] Writer thread running {{(pid=75572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 18:10:14 devstack cinder-volume[75572]: DEBUG cinder.db.api [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Building query based on filter {{(pid=75572) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 18:10:14 devstack cinder-volume[75572]: DEBUG cinder.image.image_utils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75572) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 18:10:15 devstack cinder-volume[75572]: INFO cinder.keymgr.migration [None req-e48e067c-4bc7-4d36-a65e-0754dabd1c5f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 18:10:15 devstack cinder-volume[75572]: DEBUG cinder.volume.drivers.lvm [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Updating volume stats {{(pid=75572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 18:10:15 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:15 devstack sudo[76669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:10:15 devstack sudo[76669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:15 devstack sudo[76669]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:15 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:15 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:15 devstack sudo[76673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:10:15 devstack sudo[76673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:16 devstack sudo[76673]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:16 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.804s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:16 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:16 devstack sudo[76679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:10:16 devstack sudo[76679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:17 devstack sudo[76679]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:17 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.738s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:17 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:17 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:10:17 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:18 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:18 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.783s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:18 devstack cinder-volume[75572]: DEBUG cinder.manager [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Notifying Schedulers of capabilities ... {{(pid=75572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:10:18 devstack cinder-volume[75572]: INFO cinder.volume.manager [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Driver initialization completed successfully. Jul 05 18:10:18 devstack cinder-volume[75572]: INFO cinder.manager [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Initiating service 2 cleanup Jul 05 18:10:18 devstack cinder-volume[75572]: INFO cinder.manager [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Service 2 cleanup completed. Jul 05 18:10:18 devstack cinder-volume[75572]: DEBUG cinder.service [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Creating RPC server for service cinder-volume {{(pid=75572) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 18:10:18 devstack cinder-volume[75572]: DEBUG cinder.service [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75572) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 18:10:18 devstack cinder-volume[75572]: INFO cinder.volume.manager [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 05 18:10:18 devstack cinder-volume[75572]: DEBUG cinder.volume.drivers.lvm [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Updating volume stats {{(pid=75572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 18:10:18 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:18 devstack sudo[76687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:10:18 devstack sudo[76687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:18 devstack sudo[76687]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:18 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:18 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:19 devstack sudo[76690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:10:19 devstack sudo[76690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:19 devstack sudo[76690]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:19 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.791s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:19 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:19 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:10:19 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:20 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:20 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.677s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:20 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:10:20 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:10:20 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:10:21 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Jul 05 18:10:21 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:10:21 devstack cinder-volume[75572]: INFO cinder.volume.manager [None req-d8e55bc2-ab77-429e-961d-927080c720a4 None None] Driver post RPC initialization completed successfully. Jul 05 18:10:28 devstack cinder-volume[75572]: DEBUG dbcounter [-] [75572] Writing DB stats cinder:SELECT=3 {{(pid=75572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:10:31 devstack cinder-volume[75572]: DEBUG dbcounter [-] [75572] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:10:38 devstack cinder-volume[75572]: DEBUG oslo_service.periodic_task [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running periodic task VolumeManager._thread_info {{(pid=75572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:10:38 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread count: 6 {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:10:38 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread info: [<_MainThread(MainThread, started 127554374111360)>, , , , , ] {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:11:38 devstack cinder-volume[75572]: DEBUG oslo_service.periodic_task [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:11:38 devstack cinder-volume[75572]: DEBUG cinder.volume.drivers.lvm [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Updating volume stats {{(pid=75572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 18:11:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:11:38 devstack sudo[79068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:11:38 devstack sudo[79068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:11:38 devstack sudo[79068]: pam_unix(sudo:session): session closed for user root Jul 05 18:11:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:11:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:11:38 devstack sudo[79098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:11:38 devstack sudo[79098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:11:39 devstack sudo[79098]: pam_unix(sudo:session): session closed for user root Jul 05 18:11:39 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:11:39 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:11:39 devstack sudo[79101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:11:39 devstack sudo[79101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:11:40 devstack sudo[79101]: pam_unix(sudo:session): session closed for user root Jul 05 18:11:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:11:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:11:40 devstack sudo[79104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:11:40 devstack sudo[79104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:11:40 devstack sudo[79104]: pam_unix(sudo:session): session closed for user root Jul 05 18:11:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:11:40 devstack cinder-volume[75572]: DEBUG cinder.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Notifying Schedulers of capabilities ... {{(pid=75572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:11:40 devstack cinder-volume[75572]: DEBUG oslo_service.periodic_task [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running periodic task VolumeManager._thread_info {{(pid=75572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:11:40 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread count: 6 {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:11:40 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread info: [<_MainThread(MainThread, started 127554374111360)>, , , , , ] {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:12:31 devstack cinder-volume[75572]: DEBUG dbcounter [-] [75572] Writing DB stats cinder:SELECT=1 {{(pid=75572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:12:31 devstack cinder-volume[75572]: DEBUG dbcounter [-] [75572] Writing DB stats cinder:UPDATE=1 {{(pid=75572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:12:38 devstack cinder-volume[75572]: DEBUG oslo_service.periodic_task [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:12:38 devstack cinder-volume[75572]: DEBUG cinder.volume.drivers.lvm [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Updating volume stats {{(pid=75572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 18:12:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:12:38 devstack sudo[82067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:12:38 devstack sudo[82067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:12:38 devstack sudo[82067]: pam_unix(sudo:session): session closed for user root Jul 05 18:12:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:12:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:12:38 devstack sudo[82082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:12:38 devstack sudo[82082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:12:39 devstack sudo[82082]: pam_unix(sudo:session): session closed for user root Jul 05 18:12:39 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.722s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:12:39 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:12:39 devstack sudo[82088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:12:39 devstack sudo[82088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:12:40 devstack sudo[82088]: pam_unix(sudo:session): session closed for user root Jul 05 18:12:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:12:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:12:40 devstack sudo[82096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:12:40 devstack sudo[82096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:12:40 devstack sudo[82096]: pam_unix(sudo:session): session closed for user root Jul 05 18:12:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:12:40 devstack cinder-volume[75572]: DEBUG cinder.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Notifying Schedulers of capabilities ... {{(pid=75572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:12:40 devstack cinder-volume[75572]: DEBUG oslo_service.periodic_task [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running periodic task VolumeManager._thread_info {{(pid=75572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:12:40 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread count: 6 {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:12:40 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread info: [<_MainThread(MainThread, started 127554374111360)>, , , , , ] {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:13:38 devstack cinder-volume[75572]: DEBUG oslo_service.periodic_task [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:13:38 devstack cinder-volume[75572]: DEBUG cinder.volume.drivers.lvm [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Updating volume stats {{(pid=75572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 18:13:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:13:38 devstack sudo[84138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:13:38 devstack sudo[84138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:13:38 devstack sudo[84138]: pam_unix(sudo:session): session closed for user root Jul 05 18:13:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.743s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:13:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:13:38 devstack sudo[84220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:13:38 devstack sudo[84220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:13:39 devstack sudo[84220]: pam_unix(sudo:session): session closed for user root Jul 05 18:13:39 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:13:39 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:13:39 devstack sudo[84244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:13:39 devstack sudo[84244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:13:40 devstack sudo[84244]: pam_unix(sudo:session): session closed for user root Jul 05 18:13:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:13:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:13:40 devstack sudo[84270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:13:40 devstack sudo[84270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:13:40 devstack sudo[84270]: pam_unix(sudo:session): session closed for user root Jul 05 18:13:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:13:40 devstack cinder-volume[75572]: DEBUG cinder.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Notifying Schedulers of capabilities ... {{(pid=75572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:13:40 devstack cinder-volume[75572]: DEBUG oslo_service.periodic_task [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running periodic task VolumeManager._thread_info {{(pid=75572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:13:40 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread count: 6 {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:13:40 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread info: [<_MainThread(MainThread, started 127554374111360)>, , , , , ] {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:14:31 devstack cinder-volume[75572]: DEBUG dbcounter [-] [75572] Writing DB stats cinder:SELECT=1 {{(pid=75572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:14:31 devstack cinder-volume[75572]: DEBUG dbcounter [-] [75572] Writing DB stats cinder:UPDATE=1 {{(pid=75572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:14:38 devstack cinder-volume[75572]: DEBUG oslo_service.periodic_task [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:14:38 devstack cinder-volume[75572]: DEBUG cinder.volume.drivers.lvm [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Updating volume stats {{(pid=75572) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 05 18:14:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:14:38 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 05 18:14:38 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:14:38 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Jul 05 18:14:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.753s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:14:38 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:14:38 devstack sudo[85336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:14:38 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:14:39 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root Jul 05 18:14:39 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:14:39 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:14:39 devstack sudo[85340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 05 18:14:39 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:14:40 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root Jul 05 18:14:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.701s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:14:40 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:14:40 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 05 18:14:40 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:14:41 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Jul 05 18:14:41 devstack cinder-volume[75572]: DEBUG oslo_concurrency.processutils [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.759s {{(pid=75572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:14:41 devstack cinder-volume[75572]: DEBUG cinder.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Notifying Schedulers of capabilities ... {{(pid=75572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:14:41 devstack cinder-volume[75572]: DEBUG oslo_service.periodic_task [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] Running periodic task VolumeManager._thread_info {{(pid=75572) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:14:41 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread count: 6 {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:14:41 devstack cinder-volume[75572]: DEBUG cinder.volume.manager [None req-966c0570-b36f-4b11-8f8d-1b7d6885ec24 None None] thread info: [<_MainThread(MainThread, started 127554374111360)>, , , , , ] {{(pid=75572) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:14:49 devstack cinder-volume[75393]: INFO oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Caught SIGTERM, stopping children Jul 05 18:14:49 devstack cinder-volume[75393]: DEBUG oslo_concurrency.lockutils [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Acquiring lock "singleton_lock" {{(pid=75393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 18:14:49 devstack cinder-volume[75393]: DEBUG oslo_concurrency.lockutils [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Acquired lock "singleton_lock" {{(pid=75393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 18:14:49 devstack cinder-volume[75393]: DEBUG oslo_concurrency.lockutils [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Releasing lock "singleton_lock" {{(pid=75393) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 18:14:49 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Stop services. {{(pid=75393) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 18:14:49 devstack cinder-volume[75393]: DEBUG oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Killing children. {{(pid=75393) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 18:14:49 devstack cinder-volume[75393]: INFO oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Waiting on 1 children to exit Jul 05 18:14:53 devstack cinder-volume[75572]: DEBUG oslo_concurrency.lockutils [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Acquiring lock "singleton_lock" {{(pid=75572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 18:14:53 devstack cinder-volume[75572]: DEBUG oslo_concurrency.lockutils [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Acquired lock "singleton_lock" {{(pid=75572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 18:14:53 devstack cinder-volume[75572]: DEBUG oslo_concurrency.lockutils [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Releasing lock "singleton_lock" {{(pid=75572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 18:14:53 devstack cinder-volume[75572]: WARNING amqp [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 18:14:53 devstack cinder-volume[75572]: WARNING amqp [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 18:14:53 devstack cinder-volume[75393]: INFO oslo_service.backend._eventlet.service [None req-53235fa9-7e77-4eb5-ac65-a254e031cfcc None None] Child 75572 exited with status 0 Jul 05 18:14:53 devstack cinder-volume[85779]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 18:14:53 devstack cinder-volume[85779]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 18:14:53 devstack cinder-volume[85779]: we strongly recommend against using it for new projects. Jul 05 18:14:53 devstack cinder-volume[85779]: If you are already using Eventlet, we recommend migrating to a different Jul 05 18:14:53 devstack cinder-volume[85779]: framework. For more detail see Jul 05 18:14:53 devstack cinder-volume[85779]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 18:14:53 devstack cinder-volume[85779]: import eventlet # noqa Jul 05 18:14:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 18:14:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 18:14:55 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 18:14:56 devstack cinder-volume[85779]: INFO dbcounter [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Registered counter for database cinder Jul 05 18:14:56 devstack cinder-volume[85779]: DEBUG oslo_db.sqlalchemy.engines [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85779) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG dbcounter [-] [85779] Writer thread running {{(pid=85779) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 18:14:57 devstack cinder-volume[85779]: INFO cinder.rpc [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 18:14:57 devstack cinder-volume[85779]: INFO cinder.rpc [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_db.sqlalchemy.engines [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85779) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:14:57 devstack cinder-volume[85779]: INFO cinder.volume.manager [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Determined volume DB was empty at startup. Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG cinder.volume.manager [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85779) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 18:14:57 devstack cinder-volume[85779]: INFO cinder.volume.manager [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 05 18:14:57 devstack cinder-volume[85779]: WARNING stevedore.named [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 18:14:57 devstack cinder-volume[85779]: WARNING castellan.key_manager [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 18:14:57 devstack cinder-volume[85779]: WARNING cinder.keymgr.conf_key_mgr [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 18:14:57 devstack cinder-volume[85779]: INFO cinder.volume.manager [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_db.sqlalchemy.engines [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85779) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:14:57 devstack cinder-volume[85779]: INFO oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Starting 1 workers Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Started child 86048 {{(pid=85779) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Full set of CONF: {{(pid=85779) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] ******************************************************************************** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Configuration options gathered from: {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] ================================================================================ {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] allow_availability_zone_fallback = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] allow_compression_on_image_upload = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] allowed_direct_url_schemes = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] api_rate_limit = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] auth_strategy = keystone {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_availability_zone = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_host = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_stats_polling_interval = 60 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backup_api_class = cinder.backup.api.API {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backup_name_template = backup-%s {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backup_use_same_host = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backup_use_temp_snapshot = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] chap_password = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] chap_username = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cinder_internal_tenant_project_id = df547620793140078f26daa368a4cd15 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cinder_internal_tenant_user_id = 59f135736dc1450ea30115c8066a83f9 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cluster = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] compression_format = gzip {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] compute_api_class = cinder.compute.nova.API {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] config_dir = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] config_source = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[86048]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] control_exchange = openstack {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] debug = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] default_availability_zone = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] default_group_type = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] default_volume_type = QuobyteHD {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] disk_geometry = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] driver_client_cert = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] driver_client_cert_key = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] driver_data_namespace = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] driver_ssl_cert_path = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] driver_ssl_cert_verify = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] driver_use_ssl = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] enable_new_services = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] enable_unsupported_driver = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] enabled_backends = ['QuobyteHD'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] enforce_multipath_for_image_xfer = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] filter_function = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_api_insecure = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_api_servers = ['http://192.168.122.122/image'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_api_ssl_compression = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_ca_certificates_file = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_catalog_info = image:glance:publicURL {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_certfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_keyfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_num_retries = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance_request_timeout = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] goodness_function = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] graceful_shutdown_timeout = 5 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] group_api_class = cinder.group.api.API {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] host = devstack {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_compress_on_upload = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_conversion_address_space_limit = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_conversion_cpu_limit = 60 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_conversion_disable = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_upload_use_cinder_backend = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_upload_use_internal_tenant = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_volume_cache_enabled = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_volume_cache_max_count = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] image_volume_cache_max_size_gb = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] init_host_max_objects_retrieval = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] instance_format = [instance: %(uuid)s] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] iscsi_target_flags = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] iscsi_write_cache = on {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] iser_helper = tgtadm {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] iser_ip_address = 192.168.122.122 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] iser_port = 3260 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] log_color = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] log_config_append = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] log_dir = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] log_file = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] log_options = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] log_rotate_interval = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] log_rotate_interval_type = days {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] log_rotation_type = none {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] max_age = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] max_logfile_count = 30 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] max_logfile_size_mb = 200 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] max_over_subscription_ratio = 20.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] message_reap_interval = 86400 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] message_ttl = 2592000 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] migration_create_volume_timeout_secs = 300 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] monkey_patch = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] monkey_patch_modules = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] my_ip = 192.168.122.122 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] no_snapshot_gb_quota = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] num_iser_scan_tries = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] num_shell_tries = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] num_volume_device_scan_tries = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] nvmeof_conn_info_version = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] nvmet_ns_id = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] nvmet_port_id = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] osapi_max_limit = 1000 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] osapi_volume_ext_list = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] osapi_volume_listen = 0.0.0.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] osapi_volume_listen_port = 8776 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] osapi_volume_use_ssl = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] osapi_volume_workers = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] per_volume_size_limit = -1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] periodic_fuzzy_delay = 60 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] periodic_interval = 60 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] project_id_regex = [0-9a-f\-]+ {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] public_endpoint = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] publish_errors = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] quota_backup_gigabytes = 1000 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] quota_backups = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] quota_gigabytes = 1000 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] quota_groups = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] quota_snapshots = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] quota_volumes = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] rate_limit_burst = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] rate_limit_except_level = CRITICAL {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] rate_limit_interval = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] reinit_driver_count = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] replication_device = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] report_discard_supported = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] report_interval = 120 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] reservation_clean_interval = 86400 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] reservation_expire = 86400 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[86048]: INFO cinder.volume.manager [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 18:14:57 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.remotefs [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86048) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] reserved_image_namespaces = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] reserved_percentage = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] rpc_response_timeout = 120 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] run_external_periodic_tasks = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] scst_target_driver = iscsi {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] scst_target_iqn_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_down_time = 720 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] shell_completion = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] snapshot_name_template = snapshot-%s {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] split_loggers = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] state_path = /opt/stack/data/cinder {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] storage_availability_zone = nova {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] storage_protocol = iSCSI {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] syslog_log_facility = LOG_USER {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] target_helper = lioadm {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] target_ip_address = 192.168.122.122 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] target_port = 3260 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] target_protocol = iscsi {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] target_secondary_ip_addresses = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] trace_flags = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] transfer_api_class = cinder.transfer.api.API {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] transport_url = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] until_refresh = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] use_chap_auth = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] use_default_quota_class = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] use_journal = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] use_json = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] use_multipath_for_image_xfer = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] use_stderr = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] use_syslog = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] verify_glance_signatures = enabled {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_api_class = cinder.volume.api.API {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_backend_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_clear = zero {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_clear_ionice = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_clear_size = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_copy_bps_limit = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_dd_blocksize = 1M {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_name_template = volume-%s {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_service_inithost_offload = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volume_usage_audit_period = month {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] zoning_mode = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_concurrency.disable_process_locking = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.auth_section = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.auth_type = password {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.auth_version = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.cache = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.certfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.delay_auth_decision = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.http_connect_timeout = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.include_service_catalog = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.insecure = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.interface = public {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.keyfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_password = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcache_username = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.region_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.service_token_roles_required = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.service_type = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.token_cache_time = 300 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.122/identity {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.backend = dogpile.cache.null {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.backend_argument = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.backend_expiration_time = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.config_prefix = cache.oslo {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.debug_cache_backend = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.enable_retry_client = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.enable_socket_keepalive = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.enabled = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.expiration_time = 600 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.hashclient_retry_attempts = 2 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.memcache_dead_retry = 300 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.memcache_pool_maxsize = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.memcache_sasl_enabled = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.password = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.proxies = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.redis_db = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.redis_sentinel_service_name = mymaster {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.redis_server = localhost:6379 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.retry_attempts = 2 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.retry_delay = 0.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.socket_keepalive_count = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.socket_keepalive_idle = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.socket_keepalive_interval = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.socket_timeout = 1.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86048) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 18:14:57 devstack cinder-volume[86048]: WARNING cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 18:14:57 devstack cinder-volume[86048]: WARNING cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.tls_allowed_ciphers = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.tls_cafile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.tls_certfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.tls_enabled = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.tls_keyfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cache.username = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] coordination.backend_url = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.asyncio_connection = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.asyncio_slave_connection = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.backend = sqlalchemy {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.connection = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.connection_debug = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.connection_parameters = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.connection_recycle_time = 3600 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.connection_trace = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.db_inc_retry_interval = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.db_max_retries = 20 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.db_max_retry_interval = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.db_retry_interval = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.max_overflow = 50 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.max_pool_size = 5 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.max_retries = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.mysql_wsrep_sync_wait = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.pool_timeout = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.retry_interval = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.slave_connection = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.sqlite_synchronous = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.synchronous_reader = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] database.use_db_reconnect = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.connection_string = messaging:// {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.enabled = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.es_doc_type = notification {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.es_scroll_size = 10000 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.es_scroll_time = 2m {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.filter_error_trace = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.hmac_keys = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.sentinel_service_name = mymaster {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.socket_timeout = 0.1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.trace_requests = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler.trace_sqlalchemy = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler_jaeger.process_tags = {} {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler_jaeger.service_name_prefix = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] profiler_otlp.service_name_prefix = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.enforce_new_defaults = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.enforce_scope = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.policy_default_rule = default {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.policy_file = policy.yaml {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_policy.remote_timeout = 60.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] privsep_osbrick.group = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] privsep_osbrick.helper_command = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] privsep_osbrick.user = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cinder_sys_admin.group = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cinder_sys_admin.helper_command = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] cinder_sys_admin.user = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.auth_section = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.auth_type = password {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.cafile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.certfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.collect_timing = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.insecure = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.keyfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.send_service_user_token = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.split_loggers = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] service_user.timeout = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.auth_section = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.auth_type = password {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.certfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.collect_timing = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.insecure = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.keyfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.region_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.split_loggers = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] glance.timeout = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.backend_availability_zone = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.chap_password = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.chap_username = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.disk_geometry = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.driver_client_cert = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.driver_client_cert_key = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.driver_data_namespace = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.driver_use_ssl = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.enable_unsupported_driver = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.extra_capabilities = {} {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.filter_function = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.goodness_function = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.iscsi_target_flags = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.iscsi_write_cache = on {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.iser_helper = tgtadm {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.iser_ip_address = 192.168.122.122 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.iser_port = 3260 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_host = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_login = admin {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_mount_options = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_password = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_private_key = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_share_path = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_ssh_port = 22 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.num_shell_tries = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.nvmet_port_id = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.quobyte_client_cfg = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.quobyte_volume_url = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.replication_device = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.report_discard_supported = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.reserved_percentage = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.scst_target_driver = iscsi {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.scst_target_iqn_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.storage_protocol = iSCSI {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.target_helper = tgtadm {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.target_ip_address = 192.168.122.122 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.target_port = 3260 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.target_protocol = iscsi {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.trace_flags = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.unique_fqdn_network = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.use_chap_auth = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.volume_backend_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.volume_clear = zero {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.volume_clear_ionice = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.volume_clear_size = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack quobyte-client[86053]: Reading configuration file: /etc/quobyte/client.cfg Jul 05 18:14:57 devstack quobyte-client[86053]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_reports.file_event_handler = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_reports.log_dir = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.backend_availability_zone = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] CMD "mount.quobyte" returned: 1 in 0.135s {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:14:57 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:14:57 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:14:57 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.backend_host = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.chap_password = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.chap_username = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[86048]: INFO cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae ... Jul 05 18:14:57 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 -c /etc/quobyte/client-cinder.cfg {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.chiscsi_conf = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.disk_geometry = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.driver_client_cert = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.driver_client_cert_key = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.driver_data_namespace = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.driver_use_ssl = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.extra_capabilities = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.filter_function = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.goodness_function = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.iscsi_target_flags = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.iscsi_write_cache = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.iser_helper = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.iser_ip_address = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.iser_port = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.iser_target_prefix = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_host = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_login = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_mount_options = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_password = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_private_key = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_share_path = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_ssh_port = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.num_shell_tries = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nvmet_ns_id = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.nvmet_port_id = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.replication_device = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.report_discard_supported = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.reserved_percentage = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.scst_target_driver = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.storage_protocol = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.target_helper = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.target_ip_address = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.target_port = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.target_prefix = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.target_protocol = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack sudo[86062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 -c /etc/quobyte/client-cinder.cfg Jul 05 18:14:57 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.trace_flags = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.unique_fqdn_network = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.use_chap_auth = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.volume_clear = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.volume_clear_ionice = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.volume_clear_size = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] QuobyteHD.volumes_dir = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.ssl = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.ssl_version = {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_notifications.driver = [] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_notifications.retry = -1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] oslo_messaging_notifications.transport_url = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] key_manager.fixed_key = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.barbican_api_version = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.barbican_endpoint = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.barbican_endpoint_type = public {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.barbican_region_name = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.cafile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.certfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.collect_timing = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.insecure = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.keyfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.number_of_retries = 60 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.retry_delay = 1 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.send_service_user_token = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.split_loggers = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.timeout = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.verify_ssl = True {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican.verify_ssl_path = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican_service_user.auth_section = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican_service_user.auth_type = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican_service_user.cafile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican_service_user.certfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican_service_user.collect_timing = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican_service_user.insecure = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican_service_user.keyfile = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican_service_user.split_loggers = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] barbican_service_user.timeout = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.approle_role_id = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.approle_secret_id = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.kv_mountpoint = secret {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.kv_path = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.kv_version = 2 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.namespace = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.root_token_id = **** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.ssl_ca_crt_file = None {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.timeout = 60.0 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.use_ssl = False {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:14:57 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] ******************************************************************************** {{(pid=85779) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 18:14:58 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root Jul 05 18:14:58 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.864s {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:14:58 devstack cinder-volume[86048]: INFO cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae succeeded Jul 05 18:14:58 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:14:58 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.881s {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:14:58 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:14:58 devstack sudo[86147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:14:58 devstack sudo[86147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:14:59 devstack sudo[86147]: pam_unix(sudo:session): session closed for user root Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.714s {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:14:59 devstack cinder-volume[86048]: INFO cinder.volume.driver [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG cinder.volume.driver [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7382049560547, 'free_capacity_gb': 1775.7382049560547, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86048) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG oslo_db.sqlalchemy.engines [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86048) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG dbcounter [-] [86048] Writer thread running {{(pid=86048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG cinder.db.api [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Building query based on filter {{(pid=86048) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG cinder.image.image_utils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86048) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 18:14:59 devstack cinder-volume[86048]: INFO cinder.keymgr.migration [None req-881849e6-0cfb-441e-957b-7e1ab12a4f78 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:14:59 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:14:59 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:14:59 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:15:00 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.988s {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG cinder.manager [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Notifying Schedulers of capabilities ... {{(pid=86048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:15:00 devstack cinder-volume[86048]: INFO cinder.volume.manager [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Driver initialization completed successfully. Jul 05 18:15:00 devstack cinder-volume[86048]: INFO cinder.manager [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Initiating service 3 cleanup Jul 05 18:15:00 devstack cinder-volume[86048]: INFO cinder.manager [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Service 3 cleanup completed. Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG cinder.service [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Creating RPC server for service cinder-volume {{(pid=86048) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG cinder.service [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86048) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 18:15:00 devstack cinder-volume[86048]: INFO cinder.volume.manager [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.quobyte [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:15:00 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:15:01 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:15:01 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:15:02 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Jul 05 18:15:02 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.056s {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:15:02 devstack cinder-volume[86048]: INFO cinder.volume.manager [None req-24147aa6-9db0-4c6b-b6eb-e77ecd0ba0a2 None None] Driver post RPC initialization completed successfully. Jul 05 18:15:04 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-f441fb2e-f91a-48b2-93c3-1cc0cb507f72 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:15:04 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-f441fb2e-f91a-48b2-93c3-1cc0cb507f72 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:15:04 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.quobyte [None req-f441fb2e-f91a-48b2-93c3-1cc0cb507f72 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:15:04 devstack cinder-volume[86048]: DEBUG cinder.volume.drivers.quobyte [None req-f441fb2e-f91a-48b2-93c3-1cc0cb507f72 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:15:04 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-f441fb2e-f91a-48b2-93c3-1cc0cb507f72 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:15:04 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-f441fb2e-f91a-48b2-93c3-1cc0cb507f72 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:15:04 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:15:04 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:15:05 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Jul 05 18:15:05 devstack cinder-volume[86048]: DEBUG oslo_concurrency.processutils [None req-f441fb2e-f91a-48b2-93c3-1cc0cb507f72 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.622s {{(pid=86048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:15:05 devstack cinder-volume[86048]: DEBUG cinder.manager [None req-f441fb2e-f91a-48b2-93c3-1cc0cb507f72 None None] Notifying Schedulers of capabilities ... {{(pid=86048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:15:06 devstack cinder-volume[85779]: INFO oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Caught SIGTERM, stopping children Jul 05 18:15:06 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Acquiring lock "singleton_lock" {{(pid=85779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 18:15:06 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Acquired lock "singleton_lock" {{(pid=85779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 18:15:06 devstack cinder-volume[85779]: DEBUG oslo_concurrency.lockutils [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Releasing lock "singleton_lock" {{(pid=85779) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 18:15:06 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Stop services. {{(pid=85779) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 05 18:15:06 devstack cinder-volume[85779]: DEBUG oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Killing children. {{(pid=85779) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 05 18:15:06 devstack cinder-volume[85779]: INFO oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Waiting on 1 children to exit Jul 05 18:15:09 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Acquiring lock "singleton_lock" {{(pid=86048) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 18:15:09 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Acquired lock "singleton_lock" {{(pid=86048) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 18:15:09 devstack cinder-volume[86048]: DEBUG oslo_concurrency.lockutils [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Releasing lock "singleton_lock" {{(pid=86048) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 18:15:09 devstack cinder-volume[86048]: WARNING amqp [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 18:15:09 devstack cinder-volume[86048]: WARNING amqp [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 05 18:15:09 devstack cinder-volume[85779]: INFO oslo_service.backend._eventlet.service [None req-58f312c3-67e9-4682-a1f5-65104d975aee None None] Child 86048 exited with status 0 Jul 05 18:15:09 devstack cinder-volume[86411]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 05 18:15:09 devstack cinder-volume[86411]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 18:15:09 devstack cinder-volume[86411]: we strongly recommend against using it for new projects. Jul 05 18:15:09 devstack cinder-volume[86411]: If you are already using Eventlet, we recommend migrating to a different Jul 05 18:15:09 devstack cinder-volume[86411]: framework. For more detail see Jul 05 18:15:09 devstack cinder-volume[86411]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 18:15:09 devstack cinder-volume[86411]: import eventlet # noqa Jul 05 18:15:12 devstack cinder-volume[86411]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 05 18:15:12 devstack cinder-volume[86411]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 05 18:15:12 devstack cinder-volume[86411]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86411) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 05 18:15:13 devstack cinder-volume[86411]: INFO dbcounter [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Registered counter for database cinder Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_db.sqlalchemy.engines [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG dbcounter [-] [86411] Writer thread running {{(pid=86411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 18:15:14 devstack cinder-volume[86411]: INFO cinder.rpc [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 05 18:15:14 devstack cinder-volume[86411]: INFO cinder.rpc [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_db.sqlalchemy.engines [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:15:14 devstack cinder-volume[86411]: INFO cinder.volume.manager [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Determined volume DB was empty at startup. Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG cinder.volume.manager [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86411) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 05 18:15:14 devstack cinder-volume[86411]: WARNING stevedore.named [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 05 18:15:14 devstack cinder-volume[86411]: WARNING castellan.key_manager [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 18:15:14 devstack cinder-volume[86411]: WARNING cinder.keymgr.conf_key_mgr [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 05 18:15:14 devstack cinder-volume[86411]: INFO cinder.volume.manager [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_db.sqlalchemy.engines [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:15:14 devstack cinder-volume[86411]: INFO oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Starting 1 workers Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Started child 86664 {{(pid=86411) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Full set of CONF: {{(pid=86411) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] ******************************************************************************** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] Configuration options gathered from: {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] ================================================================================ {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] allow_availability_zone_fallback = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] allow_compression_on_image_upload = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] allowed_direct_url_schemes = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] api_rate_limit = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] auth_strategy = keystone {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_availability_zone = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_host = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_stats_polling_interval = 60 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backup_api_class = cinder.backup.api.API {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86664]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backup_name_template = backup-%s {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backup_use_same_host = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backup_use_temp_snapshot = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] chap_password = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] chap_username = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cinder_internal_tenant_project_id = df547620793140078f26daa368a4cd15 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cinder_internal_tenant_user_id = 59f135736dc1450ea30115c8066a83f9 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cluster = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] compression_format = gzip {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] compute_api_class = cinder.compute.nova.API {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] config_dir = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] config_source = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] control_exchange = openstack {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] debug = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] default_availability_zone = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] default_group_type = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] default_volume_type = QuobyteHD {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] disk_geometry = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] driver_client_cert = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] driver_client_cert_key = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] driver_data_namespace = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] driver_ssl_cert_path = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] driver_ssl_cert_verify = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] driver_use_ssl = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] enable_new_services = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] enable_unsupported_driver = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] enabled_backends = ['QuobyteHD'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] enforce_multipath_for_image_xfer = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] filter_function = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_api_insecure = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_api_servers = ['http://192.168.122.122/image'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_api_ssl_compression = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_ca_certificates_file = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_catalog_info = image:glance:publicURL {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_certfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_keyfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_num_retries = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance_request_timeout = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] goodness_function = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] graceful_shutdown_timeout = 5 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] group_api_class = cinder.group.api.API {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] host = devstack {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_compress_on_upload = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_conversion_address_space_limit = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_conversion_cpu_limit = 60 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_conversion_disable = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_upload_use_cinder_backend = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_upload_use_internal_tenant = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_volume_cache_enabled = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_volume_cache_max_count = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] image_volume_cache_max_size_gb = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] init_host_max_objects_retrieval = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] instance_format = [instance: %(uuid)s] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] iscsi_target_flags = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] iscsi_write_cache = on {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] iser_helper = tgtadm {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] iser_ip_address = 192.168.122.122 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] iser_port = 3260 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] log_color = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] log_config_append = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] log_dir = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] log_file = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] log_options = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] log_rotate_interval = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] log_rotate_interval_type = days {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] log_rotation_type = none {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] max_age = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] max_logfile_count = 30 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] max_logfile_size_mb = 200 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] max_over_subscription_ratio = 20.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] message_reap_interval = 86400 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] message_ttl = 2592000 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] migration_create_volume_timeout_secs = 300 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] monkey_patch = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] monkey_patch_modules = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] my_ip = 192.168.122.122 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] no_snapshot_gb_quota = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] num_iser_scan_tries = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] num_shell_tries = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] num_volume_device_scan_tries = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] nvmeof_conn_info_version = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] nvmet_ns_id = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] nvmet_port_id = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] osapi_max_limit = 1000 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] osapi_volume_ext_list = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] osapi_volume_listen_port = 8776 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] osapi_volume_use_ssl = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] osapi_volume_workers = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] per_volume_size_limit = -1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] periodic_fuzzy_delay = 60 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] periodic_interval = 60 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] public_endpoint = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] publish_errors = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] quota_backup_gigabytes = 1000 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] quota_backups = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] quota_gigabytes = 1000 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] quota_groups = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] quota_snapshots = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] quota_volumes = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] rate_limit_burst = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] rate_limit_except_level = CRITICAL {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] rate_limit_interval = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] reinit_driver_count = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] replication_device = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] report_discard_supported = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] report_interval = 120 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] reservation_clean_interval = 86400 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] reservation_expire = 86400 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] reserved_image_namespaces = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] reserved_percentage = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] rpc_response_timeout = 120 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] run_external_periodic_tasks = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] scst_target_driver = iscsi {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] scst_target_iqn_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_down_time = 720 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] shell_completion = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] snapshot_name_template = snapshot-%s {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] split_loggers = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] state_path = /opt/stack/data/cinder {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] storage_availability_zone = nova {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] storage_protocol = iSCSI {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] syslog_log_facility = LOG_USER {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] target_helper = lioadm {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] target_ip_address = 192.168.122.122 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] target_port = 3260 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] target_protocol = iscsi {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] target_secondary_ip_addresses = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] trace_flags = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] transport_url = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] until_refresh = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] use_chap_auth = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] use_default_quota_class = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] use_journal = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] use_json = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] use_multipath_for_image_xfer = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] use_stderr = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] use_syslog = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] verify_glance_signatures = enabled {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_api_class = cinder.volume.api.API {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_backend_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_clear = zero {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_clear_ionice = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_clear_size = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_copy_bps_limit = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_dd_blocksize = 1M {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_name_template = volume-%s {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_service_inithost_offload = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volume_usage_audit_period = month {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] zoning_mode = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_concurrency.disable_process_locking = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86664) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.auth_section = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.auth_type = password {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.auth_version = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.cache = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.certfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.include_service_catalog = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.insecure = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.interface = public {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.keyfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_password = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcache_username = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.region_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.service_type = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.122/identity {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.backend = dogpile.cache.null {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.backend_argument = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.backend_expiration_time = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.config_prefix = cache.oslo {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.debug_cache_backend = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.enable_retry_client = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.enable_socket_keepalive = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.enabled = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.expiration_time = 600 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.hashclient_retry_attempts = 2 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.memcache_dead_retry = 300 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.memcache_pool_maxsize = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.memcache_sasl_enabled = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.password = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.proxies = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.redis_db = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.redis_server = localhost:6379 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.retry_attempts = 2 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.retry_delay = 0.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.socket_keepalive_count = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.socket_keepalive_idle = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.socket_keepalive_interval = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.socket_timeout = 1.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.tls_allowed_ciphers = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.tls_cafile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.tls_certfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.tls_enabled = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.tls_keyfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cache.username = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] coordination.backend_url = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.asyncio_connection = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.asyncio_slave_connection = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.backend = sqlalchemy {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.connection = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.connection_debug = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.connection_parameters = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.connection_recycle_time = 3600 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.connection_trace = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.db_inc_retry_interval = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.db_max_retries = 20 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.db_max_retry_interval = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.db_retry_interval = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.max_overflow = 50 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.max_pool_size = 5 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.max_retries = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.mysql_wsrep_sync_wait = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.pool_timeout = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.retry_interval = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.slave_connection = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.sqlite_synchronous = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.synchronous_reader = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] database.use_db_reconnect = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.connection_string = messaging:// {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.enabled = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.es_doc_type = notification {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.es_scroll_size = 10000 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.es_scroll_time = 2m {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.filter_error_trace = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.hmac_keys = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.sentinel_service_name = mymaster {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.socket_timeout = 0.1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.trace_requests = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler.trace_sqlalchemy = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler_jaeger.process_tags = {} {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler_jaeger.service_name_prefix = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] profiler_otlp.service_name_prefix = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.enforce_new_defaults = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.enforce_scope = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.policy_default_rule = default {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.policy_file = policy.yaml {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] privsep_osbrick.group = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] privsep_osbrick.helper_command = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] privsep_osbrick.user = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cinder_sys_admin.group = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cinder_sys_admin.helper_command = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] cinder_sys_admin.user = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.auth_section = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.auth_type = password {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.cafile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.certfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.collect_timing = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.insecure = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.keyfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.send_service_user_token = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.split_loggers = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] service_user.timeout = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.auth_section = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.auth_type = password {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.certfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.collect_timing = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.insecure = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.keyfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.region_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.split_loggers = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] glance.timeout = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.backend_availability_zone = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.chap_password = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.chap_username = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.disk_geometry = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.driver_client_cert = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.driver_client_cert_key = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.driver_data_namespace = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.driver_use_ssl = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.extra_capabilities = {} {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.filter_function = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.goodness_function = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.iscsi_target_flags = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.iscsi_write_cache = on {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.iser_helper = tgtadm {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.iser_ip_address = 192.168.122.122 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.iser_port = 3260 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_host = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_login = admin {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_mount_options = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_password = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_private_key = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_share_path = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.num_shell_tries = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.quobyte_volume_url = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.replication_device = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.report_discard_supported = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.reserved_percentage = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86664) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 05 18:15:14 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.quobyte [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.target_helper = tgtadm {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.target_ip_address = 192.168.122.122 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.target_port = 3260 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.target_protocol = iscsi {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.trace_flags = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.unique_fqdn_network = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.use_chap_auth = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.quobyte [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.volume_backend_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.volume_clear = zero {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.volume_clear_ionice = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.volume_clear_size = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Running cmd (subprocess): mount.quobyte {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_reports.file_event_handler = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_reports.log_dir = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.backend_availability_zone = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.backend_host = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.chap_password = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.chap_username = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.chiscsi_conf = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.disk_geometry = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.driver_client_cert = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.driver_data_namespace = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.driver_use_ssl = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.extra_capabilities = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.filter_function = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.goodness_function = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.iser_helper = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.iser_ip_address = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.iser_port = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.iser_target_prefix = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_host = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_login = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_mount_options = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_password = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_private_key = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_share_path = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_ssh_port = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.num_shell_tries = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.nvmet_port_id = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.replication_device = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.report_discard_supported = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.reserved_percentage = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.scst_target_driver = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.storage_protocol = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.target_helper = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.target_ip_address = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.target_port = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.target_prefix = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.target_protocol = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.trace_flags = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.use_chap_auth = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.volume_clear = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.volume_clear_size = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] QuobyteHD.volumes_dir = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.ssl = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_notifications.driver = [] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_notifications.retry = -1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] key_manager.fixed_key = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.barbican_api_version = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.barbican_endpoint = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.barbican_endpoint_type = public {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.barbican_region_name = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.cafile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.certfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.collect_timing = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.insecure = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.keyfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.number_of_retries = 60 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.retry_delay = 1 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.send_service_user_token = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.split_loggers = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.timeout = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.verify_ssl = True {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican.verify_ssl_path = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican_service_user.auth_section = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican_service_user.auth_type = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican_service_user.cafile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican_service_user.certfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican_service_user.collect_timing = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican_service_user.insecure = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican_service_user.keyfile = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican_service_user.split_loggers = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] barbican_service_user.timeout = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.approle_role_id = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack quobyte-client[86666]: Reading configuration file: /etc/quobyte/client.cfg Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.approle_secret_id = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.kv_mountpoint = secret {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.kv_path = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack quobyte-client[86666]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.kv_version = 2 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.namespace = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.root_token_id = **** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.ssl_ca_crt_file = None {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.timeout = 60.0 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.use_ssl = False {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 05 18:15:14 devstack cinder-volume[86411]: DEBUG oslo_service.backend._eventlet.service [None req-a0744d19-9ed5-4d60-b310-86204a262b54 None None] ******************************************************************************** {{(pid=86411) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:15:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:15:14 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:15:14 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:15:15 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.644s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:15:15 devstack cinder-volume[86664]: INFO cinder.volume.driver [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Driver hasn't implemented _init_vendor_properties() Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG cinder.volume.driver [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7357330322266, 'free_capacity_gb': 1775.7357330322266, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86664) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG oslo_db.sqlalchemy.engines [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86664) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writer thread running {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG cinder.db.api [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Building query based on filter {{(pid=86664) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86664) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:15:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:15:15 devstack cinder-volume[86664]: INFO cinder.keymgr.migration [None req-18ac37c0-2514-4349-be08-6932cece1937 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 05 18:15:15 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:15:15 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:15:16 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.611s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:15:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Driver initialization completed successfully. Jul 05 18:15:16 devstack cinder-volume[86664]: INFO cinder.manager [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Initiating service 3 cleanup Jul 05 18:15:16 devstack cinder-volume[86664]: INFO cinder.manager [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Service 3 cleanup completed. Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG cinder.service [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Creating RPC server for service cinder-volume {{(pid=86664) start /opt/stack/cinder/cinder/service.py:231}} Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG cinder.service [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86664) start /opt/stack/cinder/cinder/service.py:237}} Jul 05 18:15:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:15:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:15:16 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:15:16 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:15:17 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Jul 05 18:15:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.647s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:15:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c38e6bcd-edae-4a46-8bee-0e5fa519d4b0 None None] Driver post RPC initialization completed successfully. Jul 05 18:15:24 devstack cinder-volume[86411]: DEBUG dbcounter [-] [86411] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86411) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:15:26 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=2 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:15:27 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:16:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:16:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 6 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:16:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:16:48 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:16:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Flow 'volume_create_manager' (3a5ec11f-d09b-4883-8942-d2f9847ed287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:16:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b45b6cd-f5c7-4782-8c36-46d133cac4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b45b6cd-f5c7-4782-8c36-46d133cac4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1328996433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d987408d-1422-4954-a6d4-c39d6556358b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d12a49929e8948da864a25b5bf48e038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:16:49Z,use_quota=True,user_id='d45ac7a0fdb04cd3aefdeb1d03f85440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e178fd9-538c-4118-8f7a-69599b6e63ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e178fd9-538c-4118-8f7a-69599b6e63ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fe5626-47bf-4402-86e4-8bb70ffec42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fe5626-47bf-4402-86e4-8bb70ffec42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd987408d-1422-4954-a6d4-c39d6556358b', 'volume_name': 'volume-d987408d-1422-4954-a6d4-c39d6556358b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d18bb58-1e82-4267-8c05-a199821a5adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d18bb58-1e82-4267-8c05-a199821a5adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d507ee-3164-4b67-9a03-397ce7bdb850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:49 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Volume d987408d-1422-4954-a6d4-c39d6556358b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d987408d-1422-4954-a6d4-c39d6556358b', 'volume_size': 1} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1328996433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d987408d-1422-4954-a6d4-c39d6556358b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d12a49929e8948da864a25b5bf48e038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:16:49Z,use_quota=True,user_id='d45ac7a0fdb04cd3aefdeb1d03f85440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Creating volume d987408d-1422-4954-a6d4-c39d6556358b {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:16:49 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:16:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:16:49 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b 1073741824 Jul 05 18:16:49 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Flow 'volume_create_manager' (dbc6d0eb-b9b1-43df-a607-5e9c6975efed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a85fba-f2d9-4087-84b8-00a99c53e039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a85fba-f2d9-4087-84b8-00a99c53e039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2059685952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c790f5-504c-4237-85fa-08cca57d72e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0185ea099d46589b70980efb5622eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:16:50Z,use_quota=True,user_id='0b020bd019e047e1a8e0eb1609382867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b128515-7070-4855-960f-ff1686a9f3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b128515-7070-4855-960f-ff1686a9f3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563ba64b-1995-4880-a26e-735582a1adef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563ba64b-1995-4880-a26e-735582a1adef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c790f5-504c-4237-85fa-08cca57d72e9', 'volume_name': 'volume-50c790f5-504c-4237-85fa-08cca57d72e9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22b39e9-8b6b-4004-8d26-577137dea799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22b39e9-8b6b-4004-8d26-577137dea799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581c9a76-46b5-493c-bc14-25fbada6484a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:51 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Volume 50c790f5-504c-4237-85fa-08cca57d72e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c790f5-504c-4237-85fa-08cca57d72e9', 'volume_size': 1} Jul 05 18:16:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:16:51 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Jul 05 18:16:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b 1073741824" returned: 0 in 2.114s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:16:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:16:51 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b Jul 05 18:16:51 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:16:52 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b" returned: 0 in 1.437s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] <== create_volume: return (3670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.678s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2059685952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c790f5-504c-4237-85fa-08cca57d72e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba0185ea099d46589b70980efb5622eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:16:50Z,use_quota=True,user_id='0b020bd019e047e1a8e0eb1609382867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Creating volume 50c790f5-504c-4237-85fa-08cca57d72e9 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:16:52 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:16:52 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 1073741824 Jul 05 18:16:52 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d507ee-3164-4b67-9a03-397ce7bdb850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d987408d-1422-4954-a6d4-c39d6556358b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f934dd-d6d2-4dd3-b615-4438d623cd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:52 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Volume volume-d987408d-1422-4954-a6d4-c39d6556358b (d987408d-1422-4954-a6d4-c39d6556358b): created successfully Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f934dd-d6d2-4dd3-b615-4438d623cd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Flow 'volume_create_manager' (3a5ec11f-d09b-4883-8942-d2f9847ed287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:16:52 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4f678771-cc66-429f-bce0-c509572c05f9 tempest-VolumesAdminNegativeTest-2120660525 None] Created volume successfully. Jul 05 18:16:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Acquiring lock "cinder-d987408d-1422-4954-a6d4-c39d6556358b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:16:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "cinder-d987408d-1422-4954-a6d4-c39d6556358b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:16:55 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Jul 05 18:16:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 1073741824" returned: 0 in 2.521s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:16:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Acquiring lock "cinder-quobyte-d987408d-1422-4954-a6d4-c39d6556358b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:16:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "cinder-quobyte-d987408d-1422-4954-a6d4-c39d6556358b" acquired by "delete_volume" :: waited 0.044s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:16:55 devstack cinder-volume[86664]: INFO oslo.privsep.daemon [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplk811b63/privsep.sock'] Jul 05 18:16:55 devstack sudo[87654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplk811b63/privsep.sock Jul 05 18:16:55 devstack sudo[87654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:16:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:16:55 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 Jul 05 18:16:55 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:16:56 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Jul 05 18:16:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9" returned: 0 in 0.894s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:16:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] <== create_volume: return (3751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:16:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.760s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:16:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581c9a76-46b5-493c-bc14-25fbada6484a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c790f5-504c-4237-85fa-08cca57d72e9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9072e87-87db-4166-bbb1-bf44bb42f7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:16:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Volume volume-50c790f5-504c-4237-85fa-08cca57d72e9 (50c790f5-504c-4237-85fa-08cca57d72e9): created successfully Jul 05 18:16:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9072e87-87db-4166-bbb1-bf44bb42f7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:16:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Flow 'volume_create_manager' (dbc6d0eb-b9b1-43df-a607-5e9c6975efed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:16:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-524668b0-a5c0-4b81-8b70-b3d2ee966754 tempest-DeleteServersTestJSON-324804225 None] Created volume successfully. Jul 05 18:16:57 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 05 18:16:57 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 18:16:57 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 18:16:57 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 18:16:57 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 18:16:57 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 18:16:57 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 18:16:57 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 18:16:57 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 05 18:17:00 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 05 18:17:00 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 05 18:17:00 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 05 18:17:00 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 18:17:00 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 05 18:17:00 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 05 18:17:00 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 05 18:17:00 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: Jul 05 18:17:00 devstack cinder-volume[86664]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 05 18:17:01 devstack sudo[87654]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:01 devstack cinder-volume[86664]: INFO oslo.privsep.daemon [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Spawned new privsep daemon via rootwrap Jul 05 18:17:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Accepted privsep connection to /tmp/tmplk811b63/privsep.sock {{(pid=86664) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 05 18:17:01 devstack cinder-volume[86664]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 05 18:17:01 devstack cinder-volume[86664]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 05 18:17:01 devstack cinder-volume[86664]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 05 18:17:01 devstack cinder-volume[86664]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87679 Jul 05 18:17:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c975cb-6e1f-46bc-a5f7-fbc99c9c772f]: (2,) {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:17:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[874ca62c-e36f-47d7-b464-13968199255e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:17:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:01 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b Jul 05 18:17:01 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:03 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b" returned: 0 in 2.466s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:03 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b Jul 05 18:17:03 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:05 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d987408d-1422-4954-a6d4-c39d6556358b" returned: 0 in 1.750s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:05 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "cinder-quobyte-d987408d-1422-4954-a6d4-c39d6556358b" released by "delete_volume" :: held 9.913s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:17:05 devstack cinder-volume[86664]: WARNING cinder.quota [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:17:05 devstack cinder-volume[86664]: WARNING cinder.quota [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:17:05 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Created reservations ['8267d2f7-5e0b-48a5-83c8-b784ce41292f', '34fd334c-1294-4d65-a711-2893a115bab2', '0d6d5374-b0e1-450b-823c-6ea93758bd41', '93f48c59-e467-4a05-9643-f49ff8411bfa'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:17:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:17:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:17:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:06 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:17:06 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:08 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 2.054s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:08 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:17:08 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Deleted volume successfully. Jul 05 18:17:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a4619617-7242-4ce8-89cb-f31d0e61e849 tempest-VolumesAdminNegativeTest-2120660525 None] Lock "cinder-d987408d-1422-4954-a6d4-c39d6556358b-delete_volume" released by "delete_volume" :: held 13.043s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:17:09 devstack cinder-volume[86664]: WARNING py.warnings [req-c6ddeea2-f8ca-4743-981d-2bb1231dfb47 req-1e16b94a-9878-4f28-866a-78222972c5c8 tempest-DeleteServersTestJSON-324804225 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 05 18:17:09 devstack cinder-volume[86664]: .first() Jul 05 18:17:09 devstack cinder-volume[86664]: Jul 05 18:17:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c6ddeea2-f8ca-4743-981d-2bb1231dfb47 req-1e16b94a-9878-4f28-866a-78222972c5c8 tempest-DeleteServersTestJSON-324804225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c6ddeea2-f8ca-4743-981d-2bb1231dfb47 req-1e16b94a-9878-4f28-866a-78222972c5c8 tempest-DeleteServersTestJSON-324804225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[27933c56-d47a-4d9c-b2a7-317c06e427d4]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:17:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c6ddeea2-f8ca-4743-981d-2bb1231dfb47 req-1e16b94a-9878-4f28-866a-78222972c5c8 tempest-DeleteServersTestJSON-324804225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:09 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 Jul 05 18:17:09 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:10 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c6ddeea2-f8ca-4743-981d-2bb1231dfb47 req-1e16b94a-9878-4f28-866a-78222972c5c8 tempest-DeleteServersTestJSON-324804225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9" returned: 0 in 1.013s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c6ddeea2-f8ca-4743-981d-2bb1231dfb47 req-1e16b94a-9878-4f28-866a-78222972c5c8 tempest-DeleteServersTestJSON-324804225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.053s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-c6ddeea2-f8ca-4743-981d-2bb1231dfb47 req-1e16b94a-9878-4f28-866a-78222972c5c8 tempest-DeleteServersTestJSON-324804225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-50c790f5-504c-4237-85fa-08cca57d72e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92f886f4-de72-4a51-bf3f-fce4e59ac2f9', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:17:10 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-c6ddeea2-f8ca-4743-981d-2bb1231dfb47 req-1e16b94a-9878-4f28-866a-78222972c5c8 tempest-DeleteServersTestJSON-324804225 None] attachment_update completed successfully. Jul 05 18:17:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:17:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:17:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:17:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:12 devstack sudo[88187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:17:12 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:13 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.063s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:17:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:17:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 8 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:17:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:17:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-bfef49c5-08b5-4bbd-978d-6bd9a96e2818 req-6e35e476-e49c-486d-8a3f-e346e55121d9 tempest-DeleteServersTestJSON-324804225 None] Terminate volume connection completed successfully. Jul 05 18:17:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-bfef49c5-08b5-4bbd-978d-6bd9a96e2818 req-6e35e476-e49c-486d-8a3f-e346e55121d9 tempest-DeleteServersTestJSON-324804225 None] Deleting attachment 92f886f4-de72-4a51-bf3f-fce4e59ac2f9. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:17:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Acquiring lock "cinder-50c790f5-504c-4237-85fa-08cca57d72e9-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:17:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Lock "cinder-50c790f5-504c-4237-85fa-08cca57d72e9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:17:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Acquiring lock "cinder-quobyte-50c790f5-504c-4237-85fa-08cca57d72e9" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:17:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Lock "cinder-quobyte-50c790f5-504c-4237-85fa-08cca57d72e9" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:17:29 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b847ef4-fea5-4efc-9c39-ba2e167304c6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:17:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:29 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 Jul 05 18:17:29 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:30 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9" returned: 0 in 1.151s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:30 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9 Jul 05 18:17:30 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:31 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-50c790f5-504c-4237-85fa-08cca57d72e9" returned: 0 in 0.809s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Lock "cinder-quobyte-50c790f5-504c-4237-85fa-08cca57d72e9" released by "delete_volume" :: held 2.020s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:17:31 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Created reservations ['f5e8a2c7-2a32-4207-a6c4-ff98deef8298', '76b284c3-98cd-45d1-b77d-52c3a662874e', '8ebdf336-ee3b-41b0-bd84-816ad4d3c5c6', '928d47bc-68cc-4333-8ca8-98c65333d493'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:17:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:17:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:17:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:31 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:17:31 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:32 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.853s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:32 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:17:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Deleted volume successfully. Jul 05 18:17:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2c1bdd65-1deb-4b00-8d02-5d8f6b4f8042 tempest-DeleteServersTestJSON-324804225 None] Lock "cinder-50c790f5-504c-4237-85fa-08cca57d72e9-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:17:32 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:17:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Flow 'volume_create_manager' (d98c662e-93c5-41b7-91af-fa58be922fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:17:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a26cd3b-b05d-4a7c-8448-2427e765c876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a26cd3b-b05d-4a7c-8448-2427e765c876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1671207288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dbfdd5-35e7-4e67-a779-2a219cfe1764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e615db3dba4c4290dc4dfcf0caa724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:17:33Z,use_quota=True,user_id='a9a4f8e2825e4447a343a05f31d50459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab98c4c-702a-45b4-8737-9e5df78192b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aab98c4c-702a-45b4-8737-9e5df78192b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf4c473-efa3-4ae4-bd57-9d231732e664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf4c473-efa3-4ae4-bd57-9d231732e664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02dbfdd5-35e7-4e67-a779-2a219cfe1764', 'volume_name': 'volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173a8e7a-a3d4-4a9f-b420-02e9d088b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173a8e7a-a3d4-4a9f-b420-02e9d088b175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c80c33-9611-4ff8-99b0-89abb5de9bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Volume 02dbfdd5-35e7-4e67-a779-2a219cfe1764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764', 'volume_size': 1} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1671207288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02dbfdd5-35e7-4e67-a779-2a219cfe1764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e615db3dba4c4290dc4dfcf0caa724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:17:33Z,use_quota=True,user_id='a9a4f8e2825e4447a343a05f31d50459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Creating volume 02dbfdd5-35e7-4e67-a779-2a219cfe1764 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:17:33 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:17:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:33 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 1073741824 Jul 05 18:17:33 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:34 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 1073741824" returned: 0 in 1.218s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:34 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 Jul 05 18:17:34 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:35 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764" returned: 0 in 0.940s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:17:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c80c33-9611-4ff8-99b0-89abb5de9bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b277f4a-59cc-4cbd-882b-c897be65c2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Volume volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 (02dbfdd5-35e7-4e67-a779-2a219cfe1764): created successfully Jul 05 18:17:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b277f4a-59cc-4cbd-882b-c897be65c2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Flow 'volume_create_manager' (d98c662e-93c5-41b7-91af-fa58be922fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:17:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a152861b-cb87-4cda-8e39-34971b4552c6 tempest-TaggedAttachmentsTest-178990635 None] Created volume successfully. Jul 05 18:17:40 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:17:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Flow 'volume_create_manager' (8c6c16f6-bddc-4445-b9e3-a0cc292e6e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:17:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f69d52-5102-43ce-b111-e5a7d273c3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f69d52-5102-43ce-b111-e5a7d273c3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-408222738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d530963-f7ef-457f-9060-906274481ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac7ae223442496da9916fd6d7944112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:17:41Z,use_quota=True,user_id='6a3207bca149427bb22bb545ae7c7844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8851b280-cb77-4579-b051-ae30d0424e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8851b280-cb77-4579-b051-ae30d0424e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa886f4-a099-477e-b7de-583d19c5e91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa886f4-a099-477e-b7de-583d19c5e91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d530963-f7ef-457f-9060-906274481ae7', 'volume_name': 'volume-9d530963-f7ef-457f-9060-906274481ae7', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c988faf-c2a1-4210-ab93-aa6270108c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c988faf-c2a1-4210-ab93-aa6270108c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aab89c0-e071-4ff2-9938-1eed6406527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:41 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Volume 9d530963-f7ef-457f-9060-906274481ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d530963-f7ef-457f-9060-906274481ae7', 'volume_size': 1} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-408222738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d530963-f7ef-457f-9060-906274481ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac7ae223442496da9916fd6d7944112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:17:41Z,use_quota=True,user_id='6a3207bca149427bb22bb545ae7c7844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Creating volume 9d530963-f7ef-457f-9060-906274481ae7 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:17:41 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:17:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:41 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7 1073741824 Jul 05 18:17:41 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:42 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7 1073741824" returned: 0 in 1.460s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:42 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7 Jul 05 18:17:42 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:43 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7" returned: 0 in 0.923s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] <== create_volume: return (2449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:17:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.452s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aab89c0-e071-4ff2-9938-1eed6406527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d530963-f7ef-457f-9060-906274481ae7', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d1bfd-8db5-4c81-9d14-bcd7cae56a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:43 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Volume volume-9d530963-f7ef-457f-9060-906274481ae7 (9d530963-f7ef-457f-9060-906274481ae7): created successfully Jul 05 18:17:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d1bfd-8db5-4c81-9d14-bcd7cae56a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Flow 'volume_create_manager' (8c6c16f6-bddc-4445-b9e3-a0cc292e6e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:17:43 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1ac9e057-da9c-4534-ac65-ca7b8062885d tempest-ServersNegativeTestJSON-1688477673 None] Created volume successfully. Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=30,cinder:SELECT=30,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Flow 'volume_create_manager' (8b078afd-3369-47a0-bdb1-f12606468dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ac8eda-6c7c-44df-a752-eed8f142095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ac8eda-6c7c-44df-a752-eed8f142095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2126941644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829e665a-f355-4176-b530-869dbf53621c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac7ae223442496da9916fd6d7944112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:17:46Z,use_quota=True,user_id='6a3207bca149427bb22bb545ae7c7844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7261991-2712-4b53-9164-6ef0a835e5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7261991-2712-4b53-9164-6ef0a835e5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b981453-5d28-4722-880b-2abf5b0c87d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b981453-5d28-4722-880b-2abf5b0c87d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829e665a-f355-4176-b530-869dbf53621c', 'volume_name': 'volume-829e665a-f355-4176-b530-869dbf53621c', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241138a8-d737-46d6-b5ca-29b518ead1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241138a8-d737-46d6-b5ca-29b518ead1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0c9d75-36c6-48d0-a417-fe74bb50950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:46 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Volume 829e665a-f355-4176-b530-869dbf53621c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829e665a-f355-4176-b530-869dbf53621c', 'volume_size': 1} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2126941644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829e665a-f355-4176-b530-869dbf53621c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac7ae223442496da9916fd6d7944112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:17:46Z,use_quota=True,user_id='6a3207bca149427bb22bb545ae7c7844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Creating volume 829e665a-f355-4176-b530-869dbf53621c {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:17:46 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:17:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:46 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c 1073741824 Jul 05 18:17:46 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:47 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c 1073741824" returned: 0 in 1.164s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:47 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=23,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:17:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:47 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c Jul 05 18:17:47 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:48 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c" returned: 0 in 0.954s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:17:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0c9d75-36c6-48d0-a417-fe74bb50950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829e665a-f355-4176-b530-869dbf53621c', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf6c7dd-d8a5-4e2f-8d36-1da5ae0aa685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:17:48 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Volume volume-829e665a-f355-4176-b530-869dbf53621c (829e665a-f355-4176-b530-869dbf53621c): created successfully Jul 05 18:17:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf6c7dd-d8a5-4e2f-8d36-1da5ae0aa685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:17:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Flow 'volume_create_manager' (8b078afd-3369-47a0-bdb1-f12606468dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:17:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1e08a541-386c-4be1-9c24-614e9a492144 tempest-ServersNegativeTestJSON-1688477673 None] Created volume successfully. Jul 05 18:17:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "cinder-829e665a-f355-4176-b530-869dbf53621c-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:17:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Lock "cinder-829e665a-f355-4176-b530-869dbf53621c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:17:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "cinder-quobyte-829e665a-f355-4176-b530-869dbf53621c" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:17:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Lock "cinder-quobyte-829e665a-f355-4176-b530-869dbf53621c" acquired by "delete_volume" :: waited 0.041s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:17:53 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c28d8-7da2-4f68-9977-36804cf89399]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:17:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:54 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c Jul 05 18:17:54 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:55 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c" returned: 0 in 1.118s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:55 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c Jul 05 18:17:55 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:55 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-829e665a-f355-4176-b530-869dbf53621c" returned: 0 in 0.743s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Lock "cinder-quobyte-829e665a-f355-4176-b530-869dbf53621c" released by "delete_volume" :: held 1.934s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:17:55 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Created reservations ['298ec5c6-9465-477f-8e72-15a88231fe9f', 'd3e87b67-4157-41b9-82cd-c0d8cd923a27', '4013d47b-bd8f-440c-bafc-f10ca4452a9e', 'b6cb4688-10ac-426f-bc40-13051ef5a98a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:56 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:17:56 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "cinder-9d530963-f7ef-457f-9060-906274481ae7-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Lock "cinder-9d530963-f7ef-457f-9060-906274481ae7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "cinder-quobyte-9d530963-f7ef-457f-9060-906274481ae7" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Lock "cinder-quobyte-9d530963-f7ef-457f-9060-906274481ae7" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04a36d0-d1a0-4ec7-8a4a-130a2014dfa3]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:56 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7 Jul 05 18:17:56 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:56 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.852s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:17:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Deleted volume successfully. Jul 05 18:17:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7225167e-0e00-4aea-bc39-3805af460f3c tempest-ServersNegativeTestJSON-1688477673 None] Lock "cinder-829e665a-f355-4176-b530-869dbf53621c-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:17:57 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7" returned: 0 in 1.047s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:57 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7 Jul 05 18:17:57 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:58 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-9d530963-f7ef-457f-9060-906274481ae7" returned: 0 in 1.005s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Lock "cinder-quobyte-9d530963-f7ef-457f-9060-906274481ae7" released by "delete_volume" :: held 2.112s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:17:58 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Created reservations ['790f5e4c-9e62-46c2-8a2b-dcb2dc307707', '763f6151-7798-4427-a368-5473dbf626e1', 'c5caf49e-f4be-47ee-b994-561f3bced923', 'ad9df29e-4bff-4de8-ac24-0316cbda637a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:17:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:17:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:17:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:17:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:17:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:17:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:17:58 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:17:58 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:17:59 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Jul 05 18:17:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.826s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:17:59 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:17:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Deleted volume successfully. Jul 05 18:17:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a2ac087-5d2a-4a56-9183-738417453fcb tempest-ServersNegativeTestJSON-1688477673 None] Lock "cinder-9d530963-f7ef-457f-9060-906274481ae7-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:18:08 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:18:09 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:18:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:18:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:18:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:18:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:18:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:18:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:18:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:18:12 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:18:12 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:18:13 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Jul 05 18:18:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.505s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:18:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:18:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:18:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 8 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:18:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Flow 'volume_create_manager' (46f655cd-c139-45aa-9b7d-c4130bd28c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a20f39-b44d-4cf1-ba06-814331a0a204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a20f39-b44d-4cf1-ba06-814331a0a204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-293937280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecae487c-f540-44e5-91b4-91f2413f80d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2188b3e7309480580b01aaaf21401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:18:55Z,use_quota=True,user_id='f1fbe9af1d1a4b65bc2ceba351e1599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed16855-d5af-4715-88f8-db4b1d963085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed16855-d5af-4715-88f8-db4b1d963085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a5e03f-f8d9-494c-95ad-cb99b90b0309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a5e03f-f8d9-494c-95ad-cb99b90b0309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecae487c-f540-44e5-91b4-91f2413f80d2', 'volume_name': 'volume-ecae487c-f540-44e5-91b4-91f2413f80d2', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bd7a3a-6fef-468f-bd28-828760f258e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bd7a3a-6fef-468f-bd28-828760f258e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7ad16f-b744-447d-8c22-758afe90277a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:18:55 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Volume ecae487c-f540-44e5-91b4-91f2413f80d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecae487c-f540-44e5-91b4-91f2413f80d2', 'volume_size': 1} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-293937280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecae487c-f540-44e5-91b4-91f2413f80d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2188b3e7309480580b01aaaf21401ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:18:55Z,use_quota=True,user_id='f1fbe9af1d1a4b65bc2ceba351e1599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Creating volume ecae487c-f540-44e5-91b4-91f2413f80d2 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:18:55 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:18:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:18:55 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 1073741824 Jul 05 18:18:55 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:18:57 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Jul 05 18:18:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 1073741824" returned: 0 in 1.575s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:18:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:18:57 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 Jul 05 18:18:57 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:18:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c25377ee-3117-45cc-9c24-fff4629c6ad8 req-97531716-6e5d-4365-bf8e-71276802d8e2 tempest-TaggedAttachmentsTest-178990635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:18:58 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2" returned: 0 in 1.019s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] <== create_volume: return (2689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c25377ee-3117-45cc-9c24-fff4629c6ad8 req-97531716-6e5d-4365-bf8e-71276802d8e2 tempest-TaggedAttachmentsTest-178990635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.724s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7ad16f-b744-447d-8c22-758afe90277a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecae487c-f540-44e5-91b4-91f2413f80d2', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6acaf8a-4eb3-41b9-985e-2d077ff44b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e524c48c-21e6-4562-92fa-13fe02c584e4]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c25377ee-3117-45cc-9c24-fff4629c6ad8 req-97531716-6e5d-4365-bf8e-71276802d8e2 tempest-TaggedAttachmentsTest-178990635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:18:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Volume volume-ecae487c-f540-44e5-91b4-91f2413f80d2 (ecae487c-f540-44e5-91b4-91f2413f80d2): created successfully Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6acaf8a-4eb3-41b9-985e-2d077ff44b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:18:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Flow 'volume_create_manager' (46f655cd-c139-45aa-9b7d-c4130bd28c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:18:58 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-20d9ed0e-eb51-4793-9e7c-3404b2473193 tempest-ServerActionsTestOtherA-1103563706 None] Created volume successfully. Jul 05 18:18:58 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 Jul 05 18:18:58 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:18:59 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Jul 05 18:18:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c25377ee-3117-45cc-9c24-fff4629c6ad8 req-97531716-6e5d-4365-bf8e-71276802d8e2 tempest-TaggedAttachmentsTest-178990635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764" returned: 0 in 1.134s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:18:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c25377ee-3117-45cc-9c24-fff4629c6ad8 req-97531716-6e5d-4365-bf8e-71276802d8e2 tempest-TaggedAttachmentsTest-178990635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.180s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:18:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-c25377ee-3117-45cc-9c24-fff4629c6ad8 req-97531716-6e5d-4365-bf8e-71276802d8e2 tempest-TaggedAttachmentsTest-178990635 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9eab6508-bc7c-4f10-b4a5-1843c7e3e255', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:18:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-c25377ee-3117-45cc-9c24-fff4629c6ad8 req-97531716-6e5d-4365-bf8e-71276802d8e2 tempest-TaggedAttachmentsTest-178990635 None] attachment_update completed successfully. Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Flow 'volume_create_manager' (e07e4d65-0818-4467-9a87-f630dfdeb6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c8720a-7d71-40bd-829e-e49ebe8b4aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c8720a-7d71-40bd-829e-e49ebe8b4aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-890857750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba829f5-c782-4099-bd49-a0f913d09358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ae308506d4a44998a36ee2c71f192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:19:02Z,use_quota=True,user_id='6b284d9e500e43f1b2dcecd25bdfe74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09463aeb-41db-466b-a9e8-fa012f34d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09463aeb-41db-466b-a9e8-fa012f34d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3d74b9-8217-4647-b321-b516a2a90737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3d74b9-8217-4647-b321-b516a2a90737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba829f5-c782-4099-bd49-a0f913d09358', 'volume_name': 'volume-aba829f5-c782-4099-bd49-a0f913d09358', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981c2182-7b34-4a12-b811-c74bd67cd2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (981c2182-7b34-4a12-b811-c74bd67cd2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698a1be2-9134-4f7f-a964-b1a363631f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:02 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Volume aba829f5-c782-4099-bd49-a0f913d09358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba829f5-c782-4099-bd49-a0f913d09358', 'volume_size': 1} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-890857750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba829f5-c782-4099-bd49-a0f913d09358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb7ae308506d4a44998a36ee2c71f192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:19:02Z,use_quota=True,user_id='6b284d9e500e43f1b2dcecd25bdfe74b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Creating volume aba829f5-c782-4099-bd49-a0f913d09358 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:19:02 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:19:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:02 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358 1073741824 Jul 05 18:19:02 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:03 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358 1073741824" returned: 0 in 1.259s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:03 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358 Jul 05 18:19:03 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:04 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358" returned: 0 in 0.782s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:19:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:19:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698a1be2-9134-4f7f-a964-b1a363631f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba829f5-c782-4099-bd49-a0f913d09358', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1945e599-b8f9-4495-a90c-94fb929eb555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Volume volume-aba829f5-c782-4099-bd49-a0f913d09358 (aba829f5-c782-4099-bd49-a0f913d09358): created successfully Jul 05 18:19:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1945e599-b8f9-4495-a90c-94fb929eb555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Flow 'volume_create_manager' (e07e4d65-0818-4467-9a87-f630dfdeb6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:19:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-56127ae6-73d6-4bdd-a5de-ad29a629c74c tempest-AttachVolumeShelveTestJSON-2403422 None] Created volume successfully. Jul 05 18:19:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-51cf6340-3cad-4d46-9c91-96839814c572 req-5a61fb72-3c9b-4521-8f48-f3af7d72347b tempest-TaggedAttachmentsTest-178990635 None] Terminate volume connection completed successfully. Jul 05 18:19:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-51cf6340-3cad-4d46-9c91-96839814c572 req-5a61fb72-3c9b-4521-8f48-f3af7d72347b tempest-TaggedAttachmentsTest-178990635 None] Deleting attachment 9eab6508-bc7c-4f10-b4a5-1843c7e3e255. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:19:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:19:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:19:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:19:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:19:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:19:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:19:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:12 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:19:12 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:13 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.925s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:19:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-1031009d-500f-42c2-840d-dca4388d376f req-0ec9dc54-dd81-467a-b58b-ab383ff16c3e tempest-AttachVolumeShelveTestJSON-2403422 None] No connector for attachment 0c25bf34-b067-40f5-94ba-713766270f15; skipping storage backend terminate_connection call. {{(pid=86664) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 05 18:19:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-1031009d-500f-42c2-840d-dca4388d376f req-0ec9dc54-dd81-467a-b58b-ab383ff16c3e tempest-AttachVolumeShelveTestJSON-2403422 None] Deleting attachment 0c25bf34-b067-40f5-94ba-713766270f15. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:19:25 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:19:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Flow 'volume_create_manager' (850f28ec-67ca-48ef-9d39-50fbbaeeb084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:19:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216b44c6-96ca-42ea-b0f6-7be115b042ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216b44c6-96ca-42ea-b0f6-7be115b042ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2011389491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11310e0a-cdf5-430c-b690-3995b430f86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a0b010ff4416abcdf227cbe7cfeb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:19:26Z,use_quota=True,user_id='b716548c37394f929908e800b30d8722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0bbd2c-a8ad-466e-9c23-e3d7501d6923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0bbd2c-a8ad-466e-9c23-e3d7501d6923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93daa3a0-36c2-4a86-8578-5feefa6538f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93daa3a0-36c2-4a86-8578-5feefa6538f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11310e0a-cdf5-430c-b690-3995b430f86d', 'volume_name': 'volume-11310e0a-cdf5-430c-b690-3995b430f86d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6ccbbe-86cc-40af-bd51-9181658a0817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6ccbbe-86cc-40af-bd51-9181658a0817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c628121e-79e9-44d2-a793-85aff2ab27e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:26 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Volume 11310e0a-cdf5-430c-b690-3995b430f86d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11310e0a-cdf5-430c-b690-3995b430f86d', 'volume_size': 1} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2011389491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11310e0a-cdf5-430c-b690-3995b430f86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a0b010ff4416abcdf227cbe7cfeb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:19:26Z,use_quota=True,user_id='b716548c37394f929908e800b30d8722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Creating volume 11310e0a-cdf5-430c-b690-3995b430f86d {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:19:26 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:19:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:26 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d 1073741824 Jul 05 18:19:26 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:27 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d 1073741824" returned: 0 in 1.184s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:27 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d Jul 05 18:19:27 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:28 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d" returned: 0 in 1.226s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] <== create_volume: return (2499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:19:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.505s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:19:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c628121e-79e9-44d2-a793-85aff2ab27e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11310e0a-cdf5-430c-b690-3995b430f86d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f269da15-1786-46a9-83b6-5b9d4381a922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:19:28 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Volume volume-11310e0a-cdf5-430c-b690-3995b430f86d (11310e0a-cdf5-430c-b690-3995b430f86d): created successfully Jul 05 18:19:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f269da15-1786-46a9-83b6-5b9d4381a922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:19:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Flow 'volume_create_manager' (850f28ec-67ca-48ef-9d39-50fbbaeeb084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:19:28 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-38d870e0-3a56-4c1f-85e6-c75f73ceb4de tempest-AttachVolumeTestJSON-985090493 None] Created volume successfully. Jul 05 18:19:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Acquiring lock "cinder-02dbfdd5-35e7-4e67-a779-2a219cfe1764-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:19:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Lock "cinder-02dbfdd5-35e7-4e67-a779-2a219cfe1764-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:19:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Acquiring lock "cinder-quobyte-02dbfdd5-35e7-4e67-a779-2a219cfe1764" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:19:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Lock "cinder-quobyte-02dbfdd5-35e7-4e67-a779-2a219cfe1764" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:19:30 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[46918a03-2c0b-4c24-bc99-3962538d1d1a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:19:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:30 devstack sudo[89849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 Jul 05 18:19:30 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:31 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764" returned: 0 in 0.881s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:31 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764 Jul 05 18:19:31 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:31 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-02dbfdd5-35e7-4e67-a779-2a219cfe1764" returned: 0 in 0.837s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Lock "cinder-quobyte-02dbfdd5-35e7-4e67-a779-2a219cfe1764" released by "delete_volume" :: held 1.759s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Created reservations ['1d55cfb2-278b-4ee8-be6b-b8bccee931cf', '2016f3d6-7da2-4074-afb1-76d79be80e95', 'ddeff4c7-0433-4d42-b151-b6fc382b0f17', 'fa1ee41f-de1c-4602-96bc-3658e4afde67'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:32 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:19:32 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c72c5a03-d976-4bdb-be26-8faf7e187a86 req-6a237a55-8abb-42ba-85ff-7b07d6acca0c tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c72c5a03-d976-4bdb-be26-8faf7e187a86 req-6a237a55-8abb-42ba-85ff-7b07d6acca0c tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26cce61-4b2f-41bb-b5d6-31eec43b7edb]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c72c5a03-d976-4bdb-be26-8faf7e187a86 req-6a237a55-8abb-42ba-85ff-7b07d6acca0c tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:32 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d Jul 05 18:19:32 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:32 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.770s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:19:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Deleted volume successfully. Jul 05 18:19:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dec5a830-afda-4f74-a763-105066d12864 tempest-TaggedAttachmentsTest-178990635 None] Lock "cinder-02dbfdd5-35e7-4e67-a779-2a219cfe1764-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:19:33 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c72c5a03-d976-4bdb-be26-8faf7e187a86 req-6a237a55-8abb-42ba-85ff-7b07d6acca0c tempest-AttachVolumeTestJSON-985090493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d" returned: 0 in 0.998s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c72c5a03-d976-4bdb-be26-8faf7e187a86 req-6a237a55-8abb-42ba-85ff-7b07d6acca0c tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.025s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:19:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-c72c5a03-d976-4bdb-be26-8faf7e187a86 req-6a237a55-8abb-42ba-85ff-7b07d6acca0c tempest-AttachVolumeTestJSON-985090493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-11310e0a-cdf5-430c-b690-3995b430f86d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd15cfbf6-dc87-44f4-aba7-9ce4815e21b7', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:19:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-c72c5a03-d976-4bdb-be26-8faf7e187a86 req-6a237a55-8abb-42ba-85ff-7b07d6acca0c tempest-AttachVolumeTestJSON-985090493 None] attachment_update completed successfully. Jul 05 18:19:43 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:19:43 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=29,cinder:UPDATE=17,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:19:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-b8b10dce-7c1a-493b-b8e8-d21b77ebd431 req-9e9e6413-fbe3-41d5-a51f-d319968c53c8 tempest-ServerActionsTestOtherA-1103563706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:19:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-b8b10dce-7c1a-493b-b8e8-d21b77ebd431 req-9e9e6413-fbe3-41d5-a51f-d319968c53c8 tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:19:45 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca8d8ff-14b0-42c0-a4f6-89df8f213bad]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:19:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-b8b10dce-7c1a-493b-b8e8-d21b77ebd431 req-9e9e6413-fbe3-41d5-a51f-d319968c53c8 tempest-ServerActionsTestOtherA-1103563706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:19:45 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 Jul 05 18:19:45 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:19:46 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Jul 05 18:19:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-b8b10dce-7c1a-493b-b8e8-d21b77ebd431 req-9e9e6413-fbe3-41d5-a51f-d319968c53c8 tempest-ServerActionsTestOtherA-1103563706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2" returned: 0 in 1.151s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:19:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-b8b10dce-7c1a-493b-b8e8-d21b77ebd431 req-9e9e6413-fbe3-41d5-a51f-d319968c53c8 tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.183s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:19:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-b8b10dce-7c1a-493b-b8e8-d21b77ebd431 req-9e9e6413-fbe3-41d5-a51f-d319968c53c8 tempest-ServerActionsTestOtherA-1103563706 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-ecae487c-f540-44e5-91b4-91f2413f80d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '085c4774-0f40-40da-87d8-4df932314c60', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:19:46 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-b8b10dce-7c1a-493b-b8e8-d21b77ebd431 req-9e9e6413-fbe3-41d5-a51f-d319968c53c8 tempest-ServerActionsTestOtherA-1103563706 None] attachment_update completed successfully. Jul 05 18:19:56 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:19:56 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:19:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-53248b75-b9c4-4c14-a843-986fe76903a9 req-31332aa9-109e-4207-96de-581718a9076a tempest-ServerActionsTestOtherA-1103563706 None] Terminate volume connection completed successfully. Jul 05 18:19:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-53248b75-b9c4-4c14-a843-986fe76903a9 req-31332aa9-109e-4207-96de-581718a9076a tempest-ServerActionsTestOtherA-1103563706 None] Deleting attachment 085c4774-0f40-40da-87d8-4df932314c60. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:20:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-53248b75-b9c4-4c14-a843-986fe76903a9 req-65db51bf-5e3c-4b70-bd38-74be497b6e1b tempest-ServerActionsTestOtherA-1103563706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:20:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-53248b75-b9c4-4c14-a843-986fe76903a9 req-65db51bf-5e3c-4b70-bd38-74be497b6e1b tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:20:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ac75cd-8ab4-40ae-a562-30b8256351f0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:20:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-53248b75-b9c4-4c14-a843-986fe76903a9 req-65db51bf-5e3c-4b70-bd38-74be497b6e1b tempest-ServerActionsTestOtherA-1103563706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:01 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 Jul 05 18:20:01 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:02 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-53248b75-b9c4-4c14-a843-986fe76903a9 req-65db51bf-5e3c-4b70-bd38-74be497b6e1b tempest-ServerActionsTestOtherA-1103563706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2" returned: 0 in 1.502s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-53248b75-b9c4-4c14-a843-986fe76903a9 req-65db51bf-5e3c-4b70-bd38-74be497b6e1b tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.556s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:20:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-53248b75-b9c4-4c14-a843-986fe76903a9 req-65db51bf-5e3c-4b70-bd38-74be497b6e1b tempest-ServerActionsTestOtherA-1103563706 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-ecae487c-f540-44e5-91b4-91f2413f80d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cb44c01-c71c-40fe-a22c-f4419fd17dfd', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:20:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-53248b75-b9c4-4c14-a843-986fe76903a9 req-65db51bf-5e3c-4b70-bd38-74be497b6e1b tempest-ServerActionsTestOtherA-1103563706 None] attachment_update completed successfully. Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:12 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:20:12 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:20:12 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.910s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 8 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:20:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:20:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Acquiring lock "cinder-aba829f5-c782-4099-bd49-a0f913d09358-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:20:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "cinder-aba829f5-c782-4099-bd49-a0f913d09358-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:20:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Acquiring lock "cinder-quobyte-aba829f5-c782-4099-bd49-a0f913d09358" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:20:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "cinder-quobyte-aba829f5-c782-4099-bd49-a0f913d09358" acquired by "delete_volume" :: waited 0.047s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:20:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65cd344-56c5-4793-9184-5c3d362027b5]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:20:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:25 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358 Jul 05 18:20:25 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:26 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358" returned: 0 in 1.278s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:26 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358 Jul 05 18:20:26 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:28 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aba829f5-c782-4099-bd49-a0f913d09358" returned: 0 in 1.440s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "cinder-quobyte-aba829f5-c782-4099-bd49-a0f913d09358" released by "delete_volume" :: held 2.829s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:20:28 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Created reservations ['3696547c-9ecc-481f-b1cc-9fe7f6835bca', 'd3d1d8f4-695f-4c2c-a960-dd51efd5aa5a', 'e5d6b6a2-a989-423c-ad2c-68a4be9002ee', '98eeb3ae-f1bc-4d3e-95ed-0106d5fb1fee'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:20:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:20:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:20:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:20:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:20:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:20:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:28 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:20:28 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:29 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.040s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:29 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:20:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Deleted volume successfully. Jul 05 18:20:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3d76954-8150-49c9-a53e-ffafb1aa492b tempest-AttachVolumeShelveTestJSON-2403422 None] Lock "cinder-aba829f5-c782-4099-bd49-a0f913d09358-delete_volume" released by "delete_volume" :: held 4.402s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:20:36 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-24f9bbfe-ac3f-4717-8df0-9162761cfbc0 req-15fa03da-68cb-401a-bd59-7d51eea51794 tempest-AttachVolumeTestJSON-985090493 None] Terminate volume connection completed successfully. Jul 05 18:20:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-24f9bbfe-ac3f-4717-8df0-9162761cfbc0 req-15fa03da-68cb-401a-bd59-7d51eea51794 tempest-AttachVolumeTestJSON-985090493 None] Deleting attachment d15cfbf6-dc87-44f4-aba7-9ce4815e21b7. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:20:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-97a79647-4b3a-44c0-b464-10791106d369 req-4280ea39-4a44-4250-b82e-06d795c0a628 tempest-ServerActionsTestOtherA-1103563706 None] Terminate volume connection completed successfully. Jul 05 18:20:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-97a79647-4b3a-44c0-b464-10791106d369 req-4280ea39-4a44-4250-b82e-06d795c0a628 tempest-ServerActionsTestOtherA-1103563706 None] Deleting attachment 0cb44c01-c71c-40fe-a22c-f4419fd17dfd. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Flow 'volume_create_manager' (43bb9ab9-498c-4b5e-a829-a4e6e128bd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0257b033-0a4a-4ae9-8f66-60e938935e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0257b033-0a4a-4ae9-8f66-60e938935e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-926425504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af11feb-5a21-42cb-9df8-1d0ad8ea5e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a45010e5e44275bf68b8d643c4732b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:20:42Z,use_quota=True,user_id='98088534d87443aa928f44984c1711ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaf8212-ee18-4e3b-9601-38d87d34187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaf8212-ee18-4e3b-9601-38d87d34187e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7f5054-9bb3-41f7-ba53-8c0dc3d99309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7f5054-9bb3-41f7-ba53-8c0dc3d99309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af11feb-5a21-42cb-9df8-1d0ad8ea5e53', 'volume_name': 'volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749c6470-db51-4a06-92c1-9e1a6f710f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749c6470-db51-4a06-92c1-9e1a6f710f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ee39d4-b9f5-4b40-b623-2c02d8310a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:42 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Volume 4af11feb-5a21-42cb-9df8-1d0ad8ea5e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53', 'volume_size': 1} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-926425504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af11feb-5a21-42cb-9df8-1d0ad8ea5e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a45010e5e44275bf68b8d643c4732b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:20:42Z,use_quota=True,user_id='98088534d87443aa928f44984c1711ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Creating volume 4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:20:42 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:20:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:42 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 1073741824 Jul 05 18:20:42 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:43 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 1073741824" returned: 0 in 1.296s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:43 devstack sudo[91058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 Jul 05 18:20:43 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:45 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" returned: 0 in 1.196s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] <== create_volume: return (2593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:20:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.598s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:20:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0ee39d4-b9f5-4b40-b623-2c02d8310a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55340ccd-bd2b-4397-aa25-6b288d3ba416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:45 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Volume volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 (4af11feb-5a21-42cb-9df8-1d0ad8ea5e53): created successfully Jul 05 18:20:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55340ccd-bd2b-4397-aa25-6b288d3ba416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Flow 'volume_create_manager' (43bb9ab9-498c-4b5e-a829-a4e6e128bd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:20:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-793b9736-3fb3-45bc-bcfa-afcd4dfdfa12 req-ffc30054-9cfd-4880-a42b-56086d621d62 tempest-VolumesSnapshotsTestJSON-1340630883 None] Created volume successfully. Jul 05 18:20:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:20:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:20:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Creating offline snapshot f2a3aefe-8963-4746-afa6-80c205f71956 of volume 4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:20:46 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c295847c-0360-411f-bdd7-db7b2fab6ffe]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:20:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:46 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 Jul 05 18:20:46 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:47 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" returned: 0 in 1.444s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:47 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 1G Jul 05 18:20:47 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:49 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Flow 'volume_create_manager' (ae922add-f8b5-424d-98b6-9daa341960af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce47fd80-4c6a-4e1b-9350-7e67267dfbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 1G" returned: 0 in 1.456s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:49 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 Jul 05 18:20:49 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce47fd80-4c6a-4e1b-9350-7e67267dfbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1150088877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cfb58f-a6eb-4bc7-8f4b-527374e406fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42890c15230b430bb966d3dc48e98a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:20:49Z,use_quota=True,user_id='60e3a198ac6a418084f1e2daef2b00c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2ebccb-325a-4717-b022-0cf3fcc69391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2ebccb-325a-4717-b022-0cf3fcc69391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c258cb-054e-462d-9443-6ad6afa61810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c258cb-054e-462d-9443-6ad6afa61810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cfb58f-a6eb-4bc7-8f4b-527374e406fb', 'volume_name': 'volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2134c9bf-44f0-45dc-92c5-fc77673bfc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2134c9bf-44f0-45dc-92c5-fc77673bfc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d132b19-813d-4ad9-ad8c-55e50dfdec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:49 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Volume f6cfb58f-a6eb-4bc7-8f4b-527374e406fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb', 'volume_size': 1} Jul 05 18:20:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:20:50 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956" returned: 0 in 0.978s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:50 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 is being set with open permissions: ugo+rw Jul 05 18:20:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:50 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 Jul 05 18:20:50 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:51 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956" returned: 0 in 1.247s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:51 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.info Jul 05 18:20:51 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:52 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.info" returned: 0 in 0.954s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:52 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.info is being set with open permissions: ugo+rw Jul 05 18:20:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:52 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.info Jul 05 18:20:52 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:53 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.info" returned: 0 in 1.345s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.684s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:20:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.605s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1150088877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cfb58f-a6eb-4bc7-8f4b-527374e406fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42890c15230b430bb966d3dc48e98a65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:20:49Z,use_quota=True,user_id='60e3a198ac6a418084f1e2daef2b00c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Creating volume f6cfb58f-a6eb-4bc7-8f4b-527374e406fb {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:20:54 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:54 devstack sudo[91201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb 1073741824 Jul 05 18:20:54 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-15b2f0d4-ec80-4ef3-b059-148893ce2414 req-4e94ebf9-6de2-43d0-9e53-d95d7ae3ce33 tempest-VolumesSnapshotsTestJSON-1340630883 None] Create snapshot completed successfully Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Acquiring lock "cinder-f2a3aefe-8963-4746-afa6-80c205f71956-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-f2a3aefe-8963-4746-afa6-80c205f71956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Acquiring lock "cinder-quobyte-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-quobyte-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Acquiring lock "cinder-quobyte-f2a3aefe-8963-4746-afa6-80c205f71956" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-quobyte-f2a3aefe-8963-4746-afa6-80c205f71956" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Deleting offline snapshot f2a3aefe-8963-4746-afa6-80c205f71956 of volume 4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] snapshot_file for this snap is: volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4959ff-ab41-401c-af44-9b2e40487101]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:20:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:55 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 Jul 05 18:20:55 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Acquiring lock "cinder-ecae487c-f540-44e5-91b4-91f2413f80d2-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:20:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Lock "cinder-ecae487c-f540-44e5-91b4-91f2413f80d2-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:20:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Acquiring lock "cinder-quobyte-ecae487c-f540-44e5-91b4-91f2413f80d2" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:20:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Lock "cinder-quobyte-ecae487c-f540-44e5-91b4-91f2413f80d2" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:20:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9799a307-fe26-4a97-a846-307d0c47f47e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:20:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:56 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 Jul 05 18:20:56 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:56 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb 1073741824" returned: 0 in 2.671s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:56 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb Jul 05 18:20:56 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:57 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956" returned: 0 in 2.320s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:20:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3e575d-b45a-4216-9b40-4d0d83b09d50]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:20:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:57 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 Jul 05 18:20:57 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:58 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2" returned: 0 in 1.838s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:58 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2 Jul 05 18:20:58 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:58 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb" returned: 0 in 2.072s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] <== create_volume: return (4844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:20:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.849s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:20:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d132b19-813d-4ad9-ad8c-55e50dfdec97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745ae960-bc03-4368-9371-647e3e651ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:20:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Volume volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb (f6cfb58f-a6eb-4bc7-8f4b-527374e406fb): created successfully Jul 05 18:20:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745ae960-bc03-4368-9371-647e3e651ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:20:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Flow 'volume_create_manager' (ae922add-f8b5-424d-98b6-9daa341960af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:20:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-51ae6ad4-deac-4fff-a2c9-821dfa9ce26e tempest-ServerRescueNegativeTestJSON-1499787295 None] Created volume successfully. Jul 05 18:20:59 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" returned: 0 in 2.274s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:20:59 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Jul 05 18:20:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ecae487c-f540-44e5-91b4-91f2413f80d2" returned: 0 in 1.405s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:20:59 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 Jul 05 18:20:59 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:20:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Lock "cinder-quobyte-ecae487c-f540-44e5-91b4-91f2413f80d2" released by "delete_volume" :: held 3.342s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:20:59 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Created reservations ['8f059479-863e-44fe-ac3a-0647e9ad26fb', '263824e5-acd1-4094-a888-926057e1c0e4', 'c696124e-a93d-4caf-8b17-743d82cbc057', '1b6af202-fb06-46d4-818e-2a830b51dfbd'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:00 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:00 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:00 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956" returned: 0 in 1.336s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:00 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956 Jul 05 18:21:00 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:01 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.942s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:01 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Deleted volume successfully. Jul 05 18:21:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c1706c1-f842-49b8-81b7-c6fb92184b80 tempest-ServerActionsTestOtherA-1103563706 None] Lock "cinder-ecae487c-f540-44e5-91b4-91f2413f80d2-delete_volume" released by "delete_volume" :: held 4.805s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:01 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53.f2a3aefe-8963-4746-afa6-80c205f71956" returned: 0 in 0.773s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-quobyte-f2a3aefe-8963-4746-afa6-80c205f71956" released by "_delete_snapshot" :: held 7.099s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-quobyte-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" released by "delete_snapshot" :: held 7.136s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:01 devstack cinder-volume[86664]: WARNING cinder.quota [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:21:01 devstack cinder-volume[86664]: DEBUG cinder.quota [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Created reservations ['a50ef024-106f-4603-8b32-baaaa0cfbed4', 'dabcb90f-677e-4319-a2eb-4c05a43b781f', 'e51436d1-fc7a-44ae-b75e-ef0cabff4977', '84ad53ea-9012-4e89-ab43-f835caf53560'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Delete snapshot completed successfully. Jul 05 18:21:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-52688538-6067-4d83-b645-5309b89408d7 req-3cfd60bd-03f3-48e0-83f4-cf552ffdfb90 tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-f2a3aefe-8963-4746-afa6-80c205f71956-delete_snapshot" released by "delete_snapshot" :: held 7.368s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Acquiring lock "cinder-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Acquiring lock "cinder-quobyte-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-quobyte-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" acquired by "delete_volume" :: waited 0.087s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:03 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fc4802-a6d2-46bf-bcd0-a4f0d7c36f1d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:21:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:03 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 Jul 05 18:21:03 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:04 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" returned: 0 in 1.171s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:04 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53 Jul 05 18:21:04 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:05 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" returned: 0 in 1.130s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:05 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-quobyte-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53" released by "delete_volume" :: held 2.471s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:05 devstack cinder-volume[86664]: DEBUG cinder.quota [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Created reservations ['6ff22176-c7a0-4813-85d0-60f5483cd844', 'a61bbf8a-59d7-40b8-a95b-40d615b7e94f', 'adb9bb7b-2b63-46fa-991d-a9f995337d63', '58c3a8c8-8a3a-4b40-b7f2-b90eae52b6e2'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:05 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:05 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:06 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.728s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:06 devstack cinder-volume[86664]: DEBUG cinder.manager [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:06 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Deleted volume successfully. Jul 05 18:21:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-2b1d0c34-30c4-4b20-b4d2-4208250eb44e req-7ebeab68-ea9d-4627-8106-0af5ab7cb27e tempest-VolumesSnapshotsTestJSON-1340630883 None] Lock "cinder-4af11feb-5a21-42cb-9df8-1d0ad8ea5e53-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:21:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:12 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:12 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:13 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.397s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:21:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 8 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:21:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:21:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-62e0e8ce-4d4c-4860-bb99-53bbc002df08 tempest-GroupsTest-1766926087 None] Group tempest-Group1-443268031: creating Jul 05 18:21:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-62e0e8ce-4d4c-4860-bb99-53bbc002df08 tempest-GroupsTest-1766926087 None] Group tempest-Group1-443268031: created successfully Jul 05 18:21:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-62e0e8ce-4d4c-4860-bb99-53bbc002df08 tempest-GroupsTest-1766926087 None] Create group completed successfully. Jul 05 18:21:15 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3477ba64-aa98-4f49-a91a-5cfeb60da475 tempest-GroupsTest-1766926087 None] Group tempest-Group2-1202108432: creating Jul 05 18:21:15 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3477ba64-aa98-4f49-a91a-5cfeb60da475 tempest-GroupsTest-1766926087 None] Group tempest-Group2-1202108432: created successfully Jul 05 18:21:15 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3477ba64-aa98-4f49-a91a-5cfeb60da475 tempest-GroupsTest-1766926087 None] Create group completed successfully. Jul 05 18:21:16 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:21:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Flow 'volume_create_manager' (2436e6e4-36d8-4254-be26-a95b714aa915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249e11da-13ab-4585-aded-06bae44a1cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249e11da-13ab-4585-aded-06bae44a1cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-771317334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cb4a93b-0414-495d-9f86-5c1899c7db48,host='devstack@QuobyteHD#QuobyteHD',id=a5627fc2-3ea2-4183-ab4e-30896d47e86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7227ea7a6f24216a5d447d0490462ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:17Z,use_quota=True,user_id='ad92b7f295054a1c8f58823efe21ddd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecba2a58-5245-4639-ab73-1d2268254787),volume_type_id=ecba2a58-5245-4639-ab73-1d2268254787)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46f62ef-7ddb-44e7-bca6-cd98ab47e203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46f62ef-7ddb-44e7-bca6-cd98ab47e203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1af5fda-a9fc-44f9-8333-b1f3806f3ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1af5fda-a9fc-44f9-8333-b1f3806f3ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5627fc2-3ea2-4183-ab4e-30896d47e86c', 'volume_name': 'volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac8ae60-72d2-4010-a9eb-06c2f6a6008a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac8ae60-72d2-4010-a9eb-06c2f6a6008a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cd4208-9587-4cfd-9276-7d543b418fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:17 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Volume a5627fc2-3ea2-4183-ab4e-30896d47e86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c', 'volume_size': 1} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0cb4a93b-0414-495d-9f86-5c1899c7db48,created_at=2026-07-05T16:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-771317334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cb4a93b-0414-495d-9f86-5c1899c7db48,host='devstack@QuobyteHD#QuobyteHD',id=a5627fc2-3ea2-4183-ab4e-30896d47e86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7227ea7a6f24216a5d447d0490462ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:17Z,use_quota=True,user_id='ad92b7f295054a1c8f58823efe21ddd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecba2a58-5245-4639-ab73-1d2268254787),volume_type_id=ecba2a58-5245-4639-ab73-1d2268254787)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Creating volume a5627fc2-3ea2-4183-ab4e-30896d47e86c {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:21:17 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:21:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:17 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c 1073741824 Jul 05 18:21:17 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:18 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c 1073741824" returned: 0 in 1.443s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:18 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c Jul 05 18:21:18 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Acquiring lock "cinder-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "cinder-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Acquiring lock "cinder-quobyte-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "cinder-quobyte-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d987c9-8047-4cbf-bb37-8f7d38485827]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:19 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c" returned: 0 in 1.129s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] <== create_volume: return (2654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.661s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:19 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb Jul 05 18:21:19 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cd4208-9587-4cfd-9276-7d543b418fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf43e82-5bb5-4676-b00a-07aa2b53f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:19 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Volume volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c (a5627fc2-3ea2-4183-ab4e-30896d47e86c): created successfully Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf43e82-5bb5-4676-b00a-07aa2b53f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Flow 'volume_create_manager' (2436e6e4-36d8-4254-be26-a95b714aa915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:19 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3baad1d7-3517-4606-9518-b07d4cea3e37 tempest-GroupsTest-1766926087 None] Created volume successfully. Jul 05 18:21:20 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb" returned: 0 in 1.218s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:20 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb Jul 05 18:21:20 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:22 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb" returned: 0 in 1.234s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "cinder-quobyte-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb" released by "delete_volume" :: held 2.575s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:22 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Created reservations ['026f3783-684d-408a-b06a-b1bd969c07b5', 'ffed1444-b83b-4ed8-ae0b-cd7e1df26134', 'd48d9705-ee59-4198-b4b7-f5c9b869674b', '14ac4f16-743b-4f6a-83c5-f789700eca1d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.111s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:22 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:22 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:23 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=37,cinder:UPDATE=56,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:21:23 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=46,cinder:INSERT=12,cinder:UPDATE=45,cinder:DELETE=6 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:21:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Acquiring lock "cinder-quobyte-a5627fc2-3ea2-4183-ab4e-30896d47e86c" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Lock "cinder-quobyte-a5627fc2-3ea2-4183-ab4e-30896d47e86c" acquired by "delete_volume" :: waited 0.076s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:23 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e3a2dd-783b-44f3-a247-75348c551f32]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:21:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:23 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c Jul 05 18:21:23 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:23 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:21:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Flow 'volume_create_manager' (4a84f6ea-2948-465a-a37c-557797438252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfc71c0-d61d-4e04-a113-a6f2de6b2953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfc71c0-d61d-4e04-a113-a6f2de6b2953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-723477021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c00f18c-fe7e-4cf7-a889-bb66fa26976e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487c915106d340b1936678bf32f231d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:24Z,use_quota=True,user_id='99c129ad2cd446ecabe916ba9e42acdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7686460c-6fca-40dc-b92f-12e6886f0de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7686460c-6fca-40dc-b92f-12e6886f0de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084367fa-3529-49ae-b376-bb79945c5e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084367fa-3529-49ae-b376-bb79945c5e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c00f18c-fe7e-4cf7-a889-bb66fa26976e', 'volume_name': 'volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc99c0f-4384-4329-a8d3-f2f126162f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc99c0f-4384-4329-a8d3-f2f126162f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1791df37-7b7e-48de-8342-eafc49762c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:24 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Volume 8c00f18c-fe7e-4cf7-a889-bb66fa26976e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e', 'volume_size': 1} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-723477021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c00f18c-fe7e-4cf7-a889-bb66fa26976e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487c915106d340b1936678bf32f231d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:24Z,use_quota=True,user_id='99c129ad2cd446ecabe916ba9e42acdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Creating volume 8c00f18c-fe7e-4cf7-a889-bb66fa26976e {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:21:24 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:21:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:24 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e 1073741824 Jul 05 18:21:24 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:24 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 2.295s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:25 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Deleted volume successfully. Jul 05 18:21:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f2f3ce2a-c45a-477a-bd57-5b51bdf454fc tempest-ServerRescueNegativeTestJSON-1499787295 None] Lock "cinder-f6cfb58f-a6eb-4bc7-8f4b-527374e406fb-delete_volume" released by "delete_volume" :: held 5.579s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:25 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c" returned: 0 in 2.347s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:25 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c Jul 05 18:21:25 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:26 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e 1073741824" returned: 0 in 2.107s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:26 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e Jul 05 18:21:26 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:27 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5627fc2-3ea2-4183-ab4e-30896d47e86c" returned: 0 in 1.822s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Lock "cinder-quobyte-a5627fc2-3ea2-4183-ab4e-30896d47e86c" released by "delete_volume" :: held 4.294s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Created reservations ['bc348e5c-e886-46ea-8dd5-afd4b972e5fb'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:27 devstack cinder-volume[86664]: WARNING cinder.quota [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1357094905 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1357094905, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:21:27 devstack cinder-volume[86664]: WARNING cinder.quota [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1357094905 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1357094905, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Created reservations ['9a64a965-cbe6-4bed-ae07-d8aeb627c1b0', 'c8897624-717f-4c50-af8f-abcfe38d6846', 'f4663fd9-9fab-4d0f-8807-2447056af089', 'd9deba3d-052e-42e9-b5db-b9c0104f98d9'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:27 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:27 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:28 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e" returned: 0 in 1.574s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] <== create_volume: return (3852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.866s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1791df37-7b7e-48de-8342-eafc49762c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a114b5af-b553-4025-a883-f51f86b6a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:28 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Volume volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e (8c00f18c-fe7e-4cf7-a889-bb66fa26976e): created successfully Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a114b5af-b553-4025-a883-f51f86b6a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Flow 'volume_create_manager' (4a84f6ea-2948-465a-a37c-557797438252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:28 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b308c9c5-d5c6-475d-9f7c-be8606908e8e tempest-VolumesTestJSON-735272313 None] Created volume successfully. Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] Created reservations ['ea711875-887f-40f2-bf10-bb1ec6d7577e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:28 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:28 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:29 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.624s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:29 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-dcb1fa03-163a-4945-b0fa-015430b3f3f4 tempest-GroupsTest-1766926087 None] Delete group completed successfully. Jul 05 18:21:29 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.134s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:29 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-199143d3-7f39-46d0-9518-f0991a64df03 tempest-GroupsTest-1766926087 None] Delete group completed successfully. Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Flow 'volume_create_manager' (5b290bdb-f6b8-449f-a90e-f3c9334a719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3aadff8-789c-48c8-b533-476a19c00dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3aadff8-789c-48c8-b533-476a19c00dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-199184895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87821f4a-a348-4cef-a051-494ee28b5c52,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487c915106d340b1936678bf32f231d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:30Z,use_quota=True,user_id='99c129ad2cd446ecabe916ba9e42acdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638f512e-d4c9-4b68-83ad-e94e9f75083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638f512e-d4c9-4b68-83ad-e94e9f75083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b0cbd7-be62-4865-8366-a49c8083addf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b0cbd7-be62-4865-8366-a49c8083addf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87821f4a-a348-4cef-a051-494ee28b5c52', 'volume_name': 'volume-87821f4a-a348-4cef-a051-494ee28b5c52', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcf6eca-b17e-4038-80af-e23b5d4b0e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcf6eca-b17e-4038-80af-e23b5d4b0e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccc47e2-8296-4378-b578-4e0090f64eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:30 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Volume 87821f4a-a348-4cef-a051-494ee28b5c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87821f4a-a348-4cef-a051-494ee28b5c52', 'volume_size': 1} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-199184895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87821f4a-a348-4cef-a051-494ee28b5c52,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487c915106d340b1936678bf32f231d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:30Z,use_quota=True,user_id='99c129ad2cd446ecabe916ba9e42acdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Creating volume 87821f4a-a348-4cef-a051-494ee28b5c52 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:21:30 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:21:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:30 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52 1073741824 Jul 05 18:21:30 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3a4c837b-1477-488c-8699-cc158b429623 tempest-GroupsTest-1766926087 None] Group tempest-GroupsTest-Group-76681355: creating Jul 05 18:21:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3a4c837b-1477-488c-8699-cc158b429623 tempest-GroupsTest-1766926087 None] Group tempest-GroupsTest-Group-76681355: created successfully Jul 05 18:21:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3a4c837b-1477-488c-8699-cc158b429623 tempest-GroupsTest-1766926087 None] Create group completed successfully. Jul 05 18:21:31 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52 1073741824" returned: 0 in 1.276s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:31 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52 Jul 05 18:21:31 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:32 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:21:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Flow 'volume_create_manager' (95542e92-e801-470f-8b10-892bada73390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e17198-29bb-4cc6-9564-da69000f8a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e17198-29bb-4cc6-9564-da69000f8a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-825930291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3f16b7c-ec86-47d1-8cea-1e4f0d6aa8a0,host='devstack@QuobyteHD#QuobyteHD',id=752998a5-cf20-4e46-83bf-8c88b74c0ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7227ea7a6f24216a5d447d0490462ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:33Z,use_quota=True,user_id='ad92b7f295054a1c8f58823efe21ddd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54d6e66d-9426-4aab-961a-2c70ad4ab381),volume_type_id=54d6e66d-9426-4aab-961a-2c70ad4ab381)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f771c803-e64f-4425-bdb4-6cd1c2b3474b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:32 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f771c803-e64f-4425-bdb4-6cd1c2b3474b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdaa9d5-7f20-4d8a-af79-18144dce1030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fdaa9d5-7f20-4d8a-af79-18144dce1030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752998a5-cf20-4e46-83bf-8c88b74c0ed0', 'volume_name': 'volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99524a60-2c2a-4c25-aff4-dc4f90560c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99524a60-2c2a-4c25-aff4-dc4f90560c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954abcde-565e-4cad-9cfc-838cd7fff40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Volume 752998a5-cf20-4e46-83bf-8c88b74c0ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0', 'volume_size': 1} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52" returned: 0 in 1.246s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] <== create_volume: return (2572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.574s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3f16b7c-ec86-47d1-8cea-1e4f0d6aa8a0,created_at=2026-07-05T16:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-825930291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3f16b7c-ec86-47d1-8cea-1e4f0d6aa8a0,host='devstack@QuobyteHD#QuobyteHD',id=752998a5-cf20-4e46-83bf-8c88b74c0ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7227ea7a6f24216a5d447d0490462ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:33Z,use_quota=True,user_id='ad92b7f295054a1c8f58823efe21ddd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54d6e66d-9426-4aab-961a-2c70ad4ab381),volume_type_id=54d6e66d-9426-4aab-961a-2c70ad4ab381)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Creating volume 752998a5-cf20-4e46-83bf-8c88b74c0ed0 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:21:33 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:33 devstack sudo[91573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 1073741824 Jul 05 18:21:33 devstack sudo[91573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccc47e2-8296-4378-b578-4e0090f64eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87821f4a-a348-4cef-a051-494ee28b5c52', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9074322b-c023-4dc5-90ca-fe73c53d0071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Volume volume-87821f4a-a348-4cef-a051-494ee28b5c52 (87821f4a-a348-4cef-a051-494ee28b5c52): created successfully Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9074322b-c023-4dc5-90ca-fe73c53d0071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Flow 'volume_create_manager' (5b290bdb-f6b8-449f-a90e-f3c9334a719b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-dd51243a-ff34-486e-a4ea-3bd287e53189 tempest-VolumesTestJSON-735272313 None] Created volume successfully. Jul 05 18:21:34 devstack sudo[91573]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 1073741824" returned: 0 in 1.141s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:34 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 Jul 05 18:21:34 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Flow 'volume_create_manager' (f4e4dbdc-054a-4fd7-a3cf-86b138bc5e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d92b880a-5083-4b7d-a581-d5a55ace62a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d92b880a-5083-4b7d-a581-d5a55ace62a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1769392617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808fa0a8-ad90-4706-b3f9-db9eac194ded,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487c915106d340b1936678bf32f231d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:34Z,use_quota=True,user_id='99c129ad2cd446ecabe916ba9e42acdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060074c4-e9a2-490c-897a-1f77be3ae7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (060074c4-e9a2-490c-897a-1f77be3ae7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1d8616-4dd8-45bc-b9ca-8be120321011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1d8616-4dd8-45bc-b9ca-8be120321011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808fa0a8-ad90-4706-b3f9-db9eac194ded', 'volume_name': 'volume-808fa0a8-ad90-4706-b3f9-db9eac194ded', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da3fe40-9721-4df2-bcab-a1ab9ec6e4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da3fe40-9721-4df2-bcab-a1ab9ec6e4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a2253b-d784-4a79-8e23-774cea426964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:34 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Volume 808fa0a8-ad90-4706-b3f9-db9eac194ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808fa0a8-ad90-4706-b3f9-db9eac194ded', 'volume_size': 1} Jul 05 18:21:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:35 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0" returned: 0 in 0.815s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1769392617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808fa0a8-ad90-4706-b3f9-db9eac194ded,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='487c915106d340b1936678bf32f231d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:34Z,use_quota=True,user_id='99c129ad2cd446ecabe916ba9e42acdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Creating volume 808fa0a8-ad90-4706-b3f9-db9eac194ded {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:21:35 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:35 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded 1073741824 Jul 05 18:21:35 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (954abcde-565e-4cad-9cfc-838cd7fff40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1016d7a6-2f93-4dc7-8b28-d2973ee75bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Volume volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 (752998a5-cf20-4e46-83bf-8c88b74c0ed0): created successfully Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1016d7a6-2f93-4dc7-8b28-d2973ee75bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Flow 'volume_create_manager' (95542e92-e801-470f-8b10-892bada73390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-cbc6b7d8-bdb5-432b-8d51-ec0faa61a6a6 tempest-GroupsTest-1766926087 None] Created volume successfully. Jul 05 18:21:36 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded 1073741824" returned: 0 in 1.115s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:36 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded Jul 05 18:21:36 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Flow 'volume_create_manager' (f7184555-149d-4e19-a302-086fd149d43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc45126-df96-4b26-84e3-04b1eb350c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc45126-df96-4b26-84e3-04b1eb350c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1974572045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3f16b7c-ec86-47d1-8cea-1e4f0d6aa8a0,host='devstack@QuobyteHD#QuobyteHD',id=61b4cbf6-43af-4817-b549-d7a8e0879850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7227ea7a6f24216a5d447d0490462ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:37Z,use_quota=True,user_id='ad92b7f295054a1c8f58823efe21ddd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54d6e66d-9426-4aab-961a-2c70ad4ab381),volume_type_id=54d6e66d-9426-4aab-961a-2c70ad4ab381)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6760c5-d878-4f65-9e57-b75b6ac8f88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6760c5-d878-4f65-9e57-b75b6ac8f88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78870f1f-1e52-46a2-a556-af0a63d81112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78870f1f-1e52-46a2-a556-af0a63d81112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b4cbf6-43af-4817-b549-d7a8e0879850', 'volume_name': 'volume-61b4cbf6-43af-4817-b549-d7a8e0879850', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b191e26-b107-4e31-87b3-059576da493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b191e26-b107-4e31-87b3-059576da493b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ea36f2-ef9f-4bb3-8208-78341e47f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:36 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Volume 61b4cbf6-43af-4817-b549-d7a8e0879850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b4cbf6-43af-4817-b549-d7a8e0879850', 'volume_size': 1} Jul 05 18:21:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:37 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded" returned: 0 in 1.234s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b3f16b7c-ec86-47d1-8cea-1e4f0d6aa8a0,created_at=2026-07-05T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1974572045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b3f16b7c-ec86-47d1-8cea-1e4f0d6aa8a0,host='devstack@QuobyteHD#QuobyteHD',id=61b4cbf6-43af-4817-b549-d7a8e0879850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7227ea7a6f24216a5d447d0490462ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:37Z,use_quota=True,user_id='ad92b7f295054a1c8f58823efe21ddd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54d6e66d-9426-4aab-961a-2c70ad4ab381),volume_type_id=54d6e66d-9426-4aab-961a-2c70ad4ab381)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Creating volume 61b4cbf6-43af-4817-b549-d7a8e0879850 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:21:37 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a2253b-d784-4a79-8e23-774cea426964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808fa0a8-ad90-4706-b3f9-db9eac194ded', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:37 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850 1073741824 Jul 05 18:21:37 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efc3b35-3ee9-4d4c-92b9-59de2ff1c110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:37 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Volume volume-808fa0a8-ad90-4706-b3f9-db9eac194ded (808fa0a8-ad90-4706-b3f9-db9eac194ded): created successfully Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efc3b35-3ee9-4d4c-92b9-59de2ff1c110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Flow 'volume_create_manager' (f4e4dbdc-054a-4fd7-a3cf-86b138bc5e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-60e57d8f-d6c3-4d19-8855-039a71b47295 tempest-VolumesTestJSON-735272313 None] Created volume successfully. Jul 05 18:21:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Acquiring lock "cinder-808fa0a8-ad90-4706-b3f9-db9eac194ded-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Lock "cinder-808fa0a8-ad90-4706-b3f9-db9eac194ded-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:38 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850 1073741824" returned: 0 in 1.252s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Acquiring lock "cinder-quobyte-808fa0a8-ad90-4706-b3f9-db9eac194ded" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Lock "cinder-quobyte-808fa0a8-ad90-4706-b3f9-db9eac194ded" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:38 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850 Jul 05 18:21:38 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef256aa-e2d1-4b48-8876-ce4c1225a222]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:21:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:39 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded Jul 05 18:21:39 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:39 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850" returned: 0 in 0.724s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:21:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ea36f2-ef9f-4bb3-8208-78341e47f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b4cbf6-43af-4817-b549-d7a8e0879850', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759a932f-0f62-4d0c-b7d8-2a72e77a6435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:39 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Volume volume-61b4cbf6-43af-4817-b549-d7a8e0879850 (61b4cbf6-43af-4817-b549-d7a8e0879850): created successfully Jul 05 18:21:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759a932f-0f62-4d0c-b7d8-2a72e77a6435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Flow 'volume_create_manager' (f7184555-149d-4e19-a302-086fd149d43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-07510b51-40ac-46e6-adf1-883a60473827 tempest-GroupsTest-1766926087 None] Created volume successfully. Jul 05 18:21:39 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded" returned: 0 in 0.876s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:39 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded Jul 05 18:21:39 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:40 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-808fa0a8-ad90-4706-b3f9-db9eac194ded" returned: 0 in 0.810s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Lock "cinder-quobyte-808fa0a8-ad90-4706-b3f9-db9eac194ded" released by "delete_volume" :: held 1.738s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:40 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-431bb143-2bb7-41d8-b1f7-063632487f3b tempest-GroupsTest-1766926087 None] Update group completed successfully. Jul 05 18:21:40 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Created reservations ['c0c2f429-8fd6-4b73-b88c-ea6d92aec39d', '80392a04-89ac-4be9-ba57-2bf6abfb862c', '00b46f4b-8406-4d18-a436-5d1e6db392a5', '6abcb06c-878f-41a3-9098-0d3aef782ec6'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:40 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:40 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Acquiring lock "cinder-87821f4a-a348-4cef-a051-494ee28b5c52-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Lock "cinder-87821f4a-a348-4cef-a051-494ee28b5c52-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Acquiring lock "cinder-quobyte-87821f4a-a348-4cef-a051-494ee28b5c52" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Lock "cinder-quobyte-87821f4a-a348-4cef-a051-494ee28b5c52" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3f3b4a-8ce9-4df3-863a-ddb24df3a287]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:21:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:41 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52 Jul 05 18:21:41 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:41 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.807s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:41 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Deleted volume successfully. Jul 05 18:21:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f536e3f5-7af9-438b-997e-c46b0d2829c4 tempest-VolumesTestJSON-735272313 None] Lock "cinder-808fa0a8-ad90-4706-b3f9-db9eac194ded-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e9fe3a43-6c0b-47ad-9233-a70761b59df2 tempest-GroupsTest-1766926087 None] Update group completed successfully. Jul 05 18:21:42 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52" returned: 0 in 0.942s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:42 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52 Jul 05 18:21:42 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:42 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-87821f4a-a348-4cef-a051-494ee28b5c52" returned: 0 in 0.724s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Lock "cinder-quobyte-87821f4a-a348-4cef-a051-494ee28b5c52" released by "delete_volume" :: held 1.730s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:42 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Created reservations ['6a15b32f-fea7-4d97-80bb-6eec95fead2d', 'f637933e-f0f5-4e08-b4e9-8f6044f88b02', '6110189e-e111-4686-96e9-a2e1dbfc44b5', 'd9d3717e-703e-4edd-a6d3-12f5a6c0cd23'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:43 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:43 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Acquiring lock "cinder-8c00f18c-fe7e-4cf7-a889-bb66fa26976e-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Lock "cinder-8c00f18c-fe7e-4cf7-a889-bb66fa26976e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Acquiring lock "cinder-quobyte-8c00f18c-fe7e-4cf7-a889-bb66fa26976e" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Lock "cinder-quobyte-8c00f18c-fe7e-4cf7-a889-bb66fa26976e" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[053cd419-4327-4b6f-8421-4c214e3995e0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:21:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:43 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e Jul 05 18:21:43 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:44 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.980s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:44 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:44 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Deleted volume successfully. Jul 05 18:21:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Acquiring lock "cinder-quobyte-61b4cbf6-43af-4817-b549-d7a8e0879850" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fee6fa6b-7475-4bca-96eb-a056989c189c tempest-VolumesTestJSON-735272313 None] Lock "cinder-87821f4a-a348-4cef-a051-494ee28b5c52-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Lock "cinder-quobyte-61b4cbf6-43af-4817-b549-d7a8e0879850" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:44 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af0bbec-fb8c-40fe-b694-a807d3b223f2]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:21:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:44 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850 Jul 05 18:21:44 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:44 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e" returned: 0 in 1.331s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:45 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e Jul 05 18:21:45 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:45 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850" returned: 0 in 1.400s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:45 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850 Jul 05 18:21:45 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:46 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8c00f18c-fe7e-4cf7-a889-bb66fa26976e" returned: 0 in 1.251s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Lock "cinder-quobyte-8c00f18c-fe7e-4cf7-a889-bb66fa26976e" released by "delete_volume" :: held 2.650s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Created reservations ['c0bc55bc-2181-43be-b3d0-1ff9e178cc20', '86da8a01-bfdd-45d1-8ab2-8deb80ed9949', '205a8cf4-0081-4ffc-959c-63282398efee', '5efe057f-9779-465d-971b-cba9bb3f8e95'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:46 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:46 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:46 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-61b4cbf6-43af-4817-b549-d7a8e0879850" returned: 0 in 1.093s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Lock "cinder-quobyte-61b4cbf6-43af-4817-b549-d7a8e0879850" released by "delete_volume" :: held 2.601s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Acquiring lock "cinder-quobyte-752998a5-cf20-4e46-83bf-8c88b74c0ed0" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Lock "cinder-quobyte-752998a5-cf20-4e46-83bf-8c88b74c0ed0" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df391fe-2adc-4ddc-993f-b915b419c2af]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:21:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:47 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 Jul 05 18:21:47 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:47 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.278s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:47 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Deleted volume successfully. Jul 05 18:21:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fbe3513c-dd1f-4b41-bb0b-b0644a92faf7 tempest-VolumesTestJSON-735272313 None] Lock "cinder-8c00f18c-fe7e-4cf7-a889-bb66fa26976e-delete_volume" released by "delete_volume" :: held 4.286s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:48 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0" returned: 0 in 1.394s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:48 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0 Jul 05 18:21:48 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:49 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-752998a5-cf20-4e46-83bf-8c88b74c0ed0" returned: 0 in 0.821s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Lock "cinder-quobyte-752998a5-cf20-4e46-83bf-8c88b74c0ed0" released by "delete_volume" :: held 2.336s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Created reservations ['1f6287d3-1b1b-4060-ab65-459a528e8caa'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:49 devstack cinder-volume[86664]: WARNING cinder.quota [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-407771407 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-407771407, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:21:49 devstack cinder-volume[86664]: WARNING cinder.quota [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-407771407 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-407771407, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Created reservations ['18e37528-f538-4f6f-834c-b788c8d22166', '3568cb38-0bf3-465c-b6c1-5a5d53f5cff9', 'f4ce4e24-c4c5-4d33-a033-d00c1432514b', '7b42cc58-c0de-4152-bfab-43c2cd7a9763'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Created reservations ['1451d95b-360b-4887-8705-abd5f74ad196', '840c9d91-2394-4c90-8958-b93c3a1720d2', '35b305b7-7e4d-47f0-9c37-af86234ae892', '8e058383-d0c9-4341-aeae-e819eaea702f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:49 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:21:49 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:50 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.920s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:50 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:21:50 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a8eb957b-3914-47d4-963e-0f15a863f71f tempest-GroupsTest-1766926087 None] Delete group completed successfully. Jul 05 18:21:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3970a3df-c8a2-4c1e-b612-7c7a72ce47d2 tempest-GroupSnapshotsTest-2102797949 None] Group tempest-GroupSnapshotsTest-Group-1842719646: creating Jul 05 18:21:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3970a3df-c8a2-4c1e-b612-7c7a72ce47d2 tempest-GroupSnapshotsTest-2102797949 None] Group tempest-GroupSnapshotsTest-Group-1842719646: created successfully Jul 05 18:21:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3970a3df-c8a2-4c1e-b612-7c7a72ce47d2 tempest-GroupSnapshotsTest-2102797949 None] Create group completed successfully. Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Flow 'volume_create_manager' (033a8542-b565-4cf9-90f9-726c4d52d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba7ad7e-9b59-4b1d-a305-980a7a34240c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ba7ad7e-9b59-4b1d-a305-980a7a34240c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-100135938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29cf092d-912b-48f1-b045-7b8ead02f123,host='devstack@QuobyteHD#QuobyteHD',id=019ad6ed-8937-4a2c-b5ea-7ebdbc43d835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b0cc43a15b4fb6af041d17160366bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:57Z,use_quota=True,user_id='8fde0e3475414d86a4647fb0c170f69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54cf9372-940f-4344-9506-998026c7c5a9),volume_type_id=54cf9372-940f-4344-9506-998026c7c5a9)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f308df8c-7580-4e22-95a5-4c0b319e2deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f308df8c-7580-4e22-95a5-4c0b319e2deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ff1bab-ebbc-4ba2-b589-47784876293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ff1bab-ebbc-4ba2-b589-47784876293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '019ad6ed-8937-4a2c-b5ea-7ebdbc43d835', 'volume_name': 'volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54462ab1-5e5a-439e-924e-cdaa09a4a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54462ab1-5e5a-439e-924e-cdaa09a4a97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6b0930-56de-4b6a-8d06-350fbe4d52bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:21:57 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Volume 019ad6ed-8937-4a2c-b5ea-7ebdbc43d835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835', 'volume_size': 1} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=29cf092d-912b-48f1-b045-7b8ead02f123,created_at=2026-07-05T16:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-100135938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=29cf092d-912b-48f1-b045-7b8ead02f123,host='devstack@QuobyteHD#QuobyteHD',id=019ad6ed-8937-4a2c-b5ea-7ebdbc43d835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b0cc43a15b4fb6af041d17160366bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:21:57Z,use_quota=True,user_id='8fde0e3475414d86a4647fb0c170f69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54cf9372-940f-4344-9506-998026c7c5a9),volume_type_id=54cf9372-940f-4344-9506-998026c7c5a9)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Creating volume 019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:21:57 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:21:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:57 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 1073741824 Jul 05 18:21:57 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:21:58 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Jul 05 18:21:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 1073741824" returned: 0 in 1.644s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:21:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:21:59 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 Jul 05 18:21:59 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:00 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" returned: 0 in 1.169s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] <== create_volume: return (2900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:22:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.905s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f6b0930-56de-4b6a-8d06-350fbe4d52bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af890f7e-2d77-4d83-a160-426e351d9f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:00 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Volume volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 (019ad6ed-8937-4a2c-b5ea-7ebdbc43d835): created successfully Jul 05 18:22:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af890f7e-2d77-4d83-a160-426e351d9f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Flow 'volume_create_manager' (033a8542-b565-4cf9-90f9-726c4d52d458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:00 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3a26ea85-58c1-41b9-9f46-4e24e929e475 tempest-GroupSnapshotsTest-2102797949 None] Created volume successfully. Jul 05 18:22:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-af0068d7-6259-452d-88dd-5d3a9639d15e tempest-GroupsV320Test-597150691 None] Group tempest-GroupsV320Test-Group-2131128417: creating Jul 05 18:22:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-af0068d7-6259-452d-88dd-5d3a9639d15e tempest-GroupsV320Test-597150691 None] Group tempest-GroupsV320Test-Group-2131128417: created successfully Jul 05 18:22:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-af0068d7-6259-452d-88dd-5d3a9639d15e tempest-GroupsV320Test-597150691 None] Create group completed successfully. Jul 05 18:22:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] GroupSnapshot 4e25d2dd-90f9-4773-8426-f095fb7b46cd: creating. Jul 05 18:22:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Group snapshot 4e25d2dd-90f9-4773-8426-f095fb7b46cd: creating. {{(pid=86664) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 18:22:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Creating offline snapshot 0a05e8d5-ca66-4002-b62f-bcf907b3ab36 of volume 019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:22:02 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e8845-4e53-4dd9-9881-e1fb17968d52]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:02 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 Jul 05 18:22:02 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:03 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] Created reservations ['e503cb3c-97e5-4b17-872e-77d3fb241f26'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:22:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:03 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" returned: 0 in 1.432s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:03 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:22:03 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:03 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 1G Jul 05 18:22:03 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:04 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.286s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:04 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:22:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4dfbb70b-257d-4ae4-89d0-3826e039f5ac tempest-GroupsV320Test-597150691 None] Delete group completed successfully. Jul 05 18:22:05 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 1G" returned: 0 in 1.537s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:05 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 Jul 05 18:22:05 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:06 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36" returned: 0 in 1.275s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:06 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:22:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:06 devstack sudo[91811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 Jul 05 18:22:06 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:07 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36" returned: 0 in 1.373s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:07 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.info Jul 05 18:22:07 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:08 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.info" returned: 0 in 0.942s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:08 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:22:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:08 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.info Jul 05 18:22:08 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:09 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.info" returned: 0 in 1.054s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.797s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:10 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5f910aac-de85-49fb-bfbe-c25613808a5a tempest-GroupSnapshotsTest-2102797949 None] group_snapshot 4e25d2dd-90f9-4773-8426-f095fb7b46cd: created successfully Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:12 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:22:12 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-0a05e8d5-ca66-4002-b62f-bcf907b3ab36-c9a15563-b61b-46b2-862a-defd7456a5b4" by "_create_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-0a05e8d5-ca66-4002-b62f-bcf907b3ab36-c9a15563-b61b-46b2-862a-defd7456a5b4" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Creating volume c9a15563-b61b-46b2-862a-defd7456a5b4 from snapshot 0a05e8d5-ca66-4002-b62f-bcf907b3ab36 {{(pid=86664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-c9a15563-b61b-46b2-862a-defd7456a5b4" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-c9a15563-b61b-46b2-862a-defd7456a5b4" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] snapshot: 0a05e8d5-ca66-4002-b62f-bcf907b3ab36, volume: c9a15563-b61b-46b2-862a-defd7456a5b4, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea160374-9c03-46ac-a232-c5411381511e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:12 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 Jul 05 18:22:12 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:12 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.916s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 8 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:22:13 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36" returned: 0 in 1.071s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8447b616-c604-4767-bfda-b4bd768646fa]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:22:13 devstack sudo[91855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 Jul 05 18:22:13 devstack sudo[91855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Flow 'volume_create_manager' (4966d08c-033a-4b36-9928-fbb1c9287882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee5d99e-2b8a-48d8-8078-6704088f657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee5d99e-2b8a-48d8-8078-6704088f657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1014333936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec08b9e3-c62e-4422-8dd4-b211d2f5eb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ccbb77baa2a465b9898d2faa7b3eab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:14Z,use_quota=True,user_id='3b29a45572e942968f66af7585c1841d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99ddac1-cd0c-46a7-aff8-df12e0574d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99ddac1-cd0c-46a7-aff8-df12e0574d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b2ea6b-d4cb-4a54-9108-5a6caaf9e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b2ea6b-d4cb-4a54-9108-5a6caaf9e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec08b9e3-c62e-4422-8dd4-b211d2f5eb51', 'volume_name': 'volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74712ac9-c3a8-4000-9800-00ab4a2dd989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74712ac9-c3a8-4000-9800-00ab4a2dd989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bec804a-3098-4bad-b187-c3a1ef3f26c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:13 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51', 'volume_size': 1} Jul 05 18:22:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:14 devstack sudo[91855]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" returned: 0 in 0.994s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:14 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:22:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:14 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 Jul 05 18:22:14 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:20 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4" returned: 0 in 6.242s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:20 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d2c0c-0c8d-4656-b3b6-6baaa4fe40d6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:20 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 Jul 05 18:22:20 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Flow 'volume_create_manager' (c2b0271b-b389-4023-b3e4-dad0f5aff4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf13bf-85f1-4a86-8327-a72c8f35095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf13bf-85f1-4a86-8327-a72c8f35095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-91557753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ba10e2-5919-41ba-8ffa-c1e95eb11d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a0b010ff4416abcdf227cbe7cfeb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:21Z,use_quota=True,user_id='b716548c37394f929908e800b30d8722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a334eae-e8a7-45c8-bd3e-4d3f49f9fcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a334eae-e8a7-45c8-bd3e-4d3f49f9fcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910f6d4c-0f66-474b-bbf0-5355c50a0f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910f6d4c-0f66-474b-bbf0-5355c50a0f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ba10e2-5919-41ba-8ffa-c1e95eb11d02', 'volume_name': 'volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1ff75c-4eef-44fd-ad69-339b1892f0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed1ff75c-4eef-44fd-ad69-339b1892f0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44b421a-fd1b-4066-b1c2-034ab1ad9e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:21 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Volume 78ba10e2-5919-41ba-8ffa-c1e95eb11d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02', 'volume_size': 1} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:21 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" returned: 0 in 1.126s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:22:21 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Converted 1024.00 MB image at 164.02 MB/s Jul 05 18:22:21 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:22:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:21 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 Jul 05 18:22:21 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:22 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4" returned: 0 in 0.736s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-c9a15563-b61b-46b2-862a-defd7456a5b4" released by "_copy_volume_from_snapshot" :: held 10.289s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-0a05e8d5-ca66-4002-b62f-bcf907b3ab36-c9a15563-b61b-46b2-862a-defd7456a5b4" released by "_create_volume_from_snapshot" :: held 10.332s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.355s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.909s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1014333936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec08b9e3-c62e-4422-8dd4-b211d2f5eb51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ccbb77baa2a465b9898d2faa7b3eab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:14Z,use_quota=True,user_id='3b29a45572e942968f66af7585c1841d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Creating volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:22:22 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:22:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:22 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 1073741824 Jul 05 18:22:22 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8f1cc4d5-188b-4b3f-b6ec-ab792437394b tempest-GroupSnapshotsTest-2102797949 None] Create group from source-snapshot-4e25d2dd-90f9-4773-8426-f095fb7b46cd completed successfully. Jul 05 18:22:23 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 1073741824" returned: 0 in 0.999s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:23 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=85,cinder:DELETE=6,cinder:SELECT=77,cinder:INSERT=17 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:22:23 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=80,cinder:INSERT=18,cinder:UPDATE=88,cinder:DELETE=4 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:22:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:23 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 Jul 05 18:22:23 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-c9a15563-b61b-46b2-862a-defd7456a5b4" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-c9a15563-b61b-46b2-862a-defd7456a5b4" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c123fdc8-8034-4307-8c08-d17515c949e7]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:24 devstack sudo[91927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 Jul 05 18:22:24 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:24 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" returned: 0 in 0.780s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.413s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-91557753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ba10e2-5919-41ba-8ffa-c1e95eb11d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a0b010ff4416abcdf227cbe7cfeb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:21Z,use_quota=True,user_id='b716548c37394f929908e800b30d8722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Creating volume 78ba10e2-5919-41ba-8ffa-c1e95eb11d02 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:22:24 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:24 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 1073741824 Jul 05 18:22:24 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bec804a-3098-4bad-b187-c3a1ef3f26c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df70abda-d00d-409a-9468-eaa7b33003b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:24 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Volume volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 (ec08b9e3-c62e-4422-8dd4-b211d2f5eb51): created successfully Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df70abda-d00d-409a-9468-eaa7b33003b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Flow 'volume_create_manager' (4966d08c-033a-4b36-9928-fbb1c9287882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:24 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-38fb2c7b-0515-46c7-a231-7f3cbf2cc76a tempest-SnapshotsActionsTest-2090009758 None] Created volume successfully. Jul 05 18:22:25 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4" returned: 0 in 0.940s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:25 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4 Jul 05 18:22:25 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:25 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 1073741824" returned: 0 in 1.176s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:25 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 Jul 05 18:22:25 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:26 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c9a15563-b61b-46b2-862a-defd7456a5b4" returned: 0 in 0.905s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-c9a15563-b61b-46b2-862a-defd7456a5b4" released by "delete_volume" :: held 1.914s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['7ad9a8c3-507a-4c79-a8f3-03c2c0baab2e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:22:26 devstack cinder-volume[86664]: WARNING cinder.quota [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1866809367 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1866809367, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:22:26 devstack cinder-volume[86664]: WARNING cinder.quota [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1866809367 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1866809367, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['2975a319-fa1d-420c-9232-f4f92530d6be', 'aa8d9dc8-0a31-4e8c-9e33-868ab4329e6a', 'e19d6593-2488-48d4-9725-52ac5d8c7a86', '776ed7c0-108b-4d31-8b6a-e825f70af1ad'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:22:26 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02" returned: 0 in 0.819s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.068s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44b421a-fd1b-4066-b1c2-034ab1ad9e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a51c0bc-58c3-4719-b480-8a395400f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:26 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:22:26 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Creating offline snapshot 44d334bd-14f2-44ca-86c0-b3779ee3f77d of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:22:27 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Volume volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 (78ba10e2-5919-41ba-8ffa-c1e95eb11d02): created successfully Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a51c0bc-58c3-4719-b480-8a395400f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Flow 'volume_create_manager' (c2b0271b-b389-4023-b3e4-dad0f5aff4eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bdf1ea-a364-4e63-8d6a-bd3d36365c20]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] group_snapshot 4e25d2dd-90f9-4773-8426-f095fb7b46cd: deleting Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b6e6a96d-f037-4268-8112-3a798770c8a8 tempest-AttachVolumeTestJSON-985090493 None] Created volume successfully. Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] group_snapshot 4e25d2dd-90f9-4773-8426-f095fb7b46cd: deleting {{(pid=86664) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-0a05e8d5-ca66-4002-b62f-bcf907b3ab36" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-0a05e8d5-ca66-4002-b62f-bcf907b3ab36" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Deleting offline snapshot 0a05e8d5-ca66-4002-b62f-bcf907b3ab36 of volume 019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] snapshot_file for this snap is: volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:22:27 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[659bf797-8889-4082-b440-6b9434176a35]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:27 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:27 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 Jul 05 18:22:27 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:28 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.282s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:28 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:22:28 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b312726e-da47-48bd-a439-97cef0272599 tempest-GroupSnapshotsTest-2102797949 None] Delete group completed successfully. Jul 05 18:22:28 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" returned: 0 in 1.409s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:28 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d 1G Jul 05 18:22:28 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:28 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36" returned: 0 in 1.606s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:22:29 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e737a09-8479-44dc-8b6b-183b877688f4]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:29 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 Jul 05 18:22:29 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:29 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d 1G" returned: 0 in 1.232s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:29 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:22:29 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:29 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" returned: 0 in 0.899s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:29 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 Jul 05 18:22:29 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:30 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 1.220s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:30 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d is being set with open permissions: ugo+rw Jul 05 18:22:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:30 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:22:30 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-9bfe9744-d24e-4edd-9815-8512712f0e41 req-56d9a6ba-881d-4d3b-b809-c80685192ec8 tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:31 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36" returned: 0 in 1.538s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:31 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36 Jul 05 18:22:31 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:31 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 0.959s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:31 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.info Jul 05 18:22:32 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:32 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835.0a05e8d5-ca66-4002-b62f-bcf907b3ab36" returned: 0 in 0.853s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-0a05e8d5-ca66-4002-b62f-bcf907b3ab36" released by "_delete_snapshot" :: held 5.108s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" released by "delete_snapshot" :: held 5.182s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:32 devstack cinder-volume[86664]: WARNING cinder.quota [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1866809367 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1866809367, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:22:32 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['a23b0b99-9775-44af-bb95-a2be0b4488f9', '6167bd44-5d28-43ee-9be0-3e84b0f4fc55', '6e2f01e8-631e-4e9c-8c60-85c8675aa492', '74f29df4-7050-482d-89fa-972b8138cf79'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:22:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2ba3a6e7-c64d-48ec-93f7-38a408045826 tempest-GroupSnapshotsTest-2102797949 None] group_snapshot 4e25d2dd-90f9-4773-8426-f095fb7b46cd: deleted successfully Jul 05 18:22:32 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.info" returned: 0 in 0.879s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:32 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.info is being set with open permissions: ugo+rw Jul 05 18:22:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:32 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.info Jul 05 18:22:32 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:33 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0c66cd-5fc2-4ed2-b7f4-36349343e743]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:33 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:33 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 Jul 05 18:22:33 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.info" returned: 0 in 0.920s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.114s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-9bfe9744-d24e-4edd-9815-8512712f0e41 req-56d9a6ba-881d-4d3b-b809-c80685192ec8 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.395s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:33 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6867019-d036-44af-bc97-19bd56311615]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-9bfe9744-d24e-4edd-9815-8512712f0e41 req-56d9a6ba-881d-4d3b-b809-c80685192ec8 tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2e9f93c0-bd15-4919-b500-c9446e237976 tempest-SnapshotsActionsTest-2090009758 None] Create snapshot completed successfully Jul 05 18:22:34 devstack sudo[92129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 Jul 05 18:22:34 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:34 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" returned: 0 in 1.212s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:34 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835 Jul 05 18:22:34 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:34 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-9bfe9744-d24e-4edd-9815-8512712f0e41 req-56d9a6ba-881d-4d3b-b809-c80685192ec8 tempest-AttachVolumeTestJSON-985090493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02" returned: 0 in 1.112s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-9bfe9744-d24e-4edd-9815-8512712f0e41 req-56d9a6ba-881d-4d3b-b809-c80685192ec8 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.175s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.276s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Creating offline snapshot 8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:22:35 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fd8dce-6cca-4547-840c-9bdaf2bf261d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-9bfe9744-d24e-4edd-9815-8512712f0e41 req-56d9a6ba-881d-4d3b-b809-c80685192ec8 tempest-AttachVolumeTestJSON-985090493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baa950aa-ee4a-4a98-bf3a-7039ae547d94', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:22:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-9bfe9744-d24e-4edd-9815-8512712f0e41 req-56d9a6ba-881d-4d3b-b809-c80685192ec8 tempest-AttachVolumeTestJSON-985090493 None] attachment_update completed successfully. Jul 05 18:22:35 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:22:35 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:35 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" returned: 0 in 0.983s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-019ad6ed-8937-4a2c-b5ea-7ebdbc43d835" released by "delete_volume" :: held 2.329s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:35 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['adfc90cb-94bc-4497-8d5b-623abc84a73a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:22:35 devstack cinder-volume[86664]: WARNING cinder.db.api [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1866809367'] Jul 05 18:22:35 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['be85ac78-e639-4376-bdb7-b9591dcebcd9', 'd6fc928d-a9b4-4ed1-8a4a-3d0577b27a28', '5d0c4694-3f08-4330-9d25-062e2043187c', 'e40a18b5-c45c-4e5c-bdc1-94ee4c46f68d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:36 devstack sudo[92213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:22:36 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:36 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 1.092s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:36 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a 1G Jul 05 18:22:36 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:36 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.844s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:36 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:22:36 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ce3e1d7d-411b-46f9-b630-c211b97c3e7a tempest-GroupSnapshotsTest-2102797949 None] Delete group completed successfully. Jul 05 18:22:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6aa228c4-3ec2-4dc8-a4f0-5ae6b1f02f04 tempest-GroupSnapshotsTest-2102797949 None] Group tempest-GroupSnapshotsTest-Group-407250256: creating Jul 05 18:22:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6aa228c4-3ec2-4dc8-a4f0-5ae6b1f02f04 tempest-GroupSnapshotsTest-2102797949 None] Group tempest-GroupSnapshotsTest-Group-407250256: created successfully Jul 05 18:22:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6aa228c4-3ec2-4dc8-a4f0-5ae6b1f02f04 tempest-GroupSnapshotsTest-2102797949 None] Create group completed successfully. Jul 05 18:22:37 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a 1G" returned: 0 in 1.206s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:37 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a Jul 05 18:22:37 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:38 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a" returned: 0 in 0.722s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:38 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a is being set with open permissions: ugo+rw Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:38 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a Jul 05 18:22:38 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Flow 'volume_create_manager' (7d692065-0df1-4e58-88aa-2cd7fecdca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48f1ed3-4565-4aae-923c-1e95be06ca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48f1ed3-4565-4aae-923c-1e95be06ca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-538566187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e536301-a0c1-4ca9-8c9d-2a3d4a74a3f8,host='devstack@QuobyteHD#QuobyteHD',id=e362faaa-fb66-4b9b-b254-b32626121fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b0cc43a15b4fb6af041d17160366bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:39Z,use_quota=True,user_id='8fde0e3475414d86a4647fb0c170f69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d53d493-ac04-4e84-8296-062d4af26da3),volume_type_id=9d53d493-ac04-4e84-8296-062d4af26da3)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5004e7a6-7400-49f4-8330-d15525f9e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5004e7a6-7400-49f4-8330-d15525f9e173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c886987b-9224-4243-bed1-f6c9333cbebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c886987b-9224-4243-bed1-f6c9333cbebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e362faaa-fb66-4b9b-b254-b32626121fc4', 'volume_name': 'volume-e362faaa-fb66-4b9b-b254-b32626121fc4', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f228a95-b758-4b6c-aa64-d375bde22dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f228a95-b758-4b6c-aa64-d375bde22dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659442af-a99d-4ef8-82e1-b26408d19475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:38 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Volume e362faaa-fb66-4b9b-b254-b32626121fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e362faaa-fb66-4b9b-b254-b32626121fc4', 'volume_size': 1} Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:38 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a" returned: 0 in 0.869s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.040s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e536301-a0c1-4ca9-8c9d-2a3d4a74a3f8,created_at=2026-07-05T16:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-538566187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e536301-a0c1-4ca9-8c9d-2a3d4a74a3f8,host='devstack@QuobyteHD#QuobyteHD',id=e362faaa-fb66-4b9b-b254-b32626121fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b0cc43a15b4fb6af041d17160366bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:39Z,use_quota=True,user_id='8fde0e3475414d86a4647fb0c170f69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d53d493-ac04-4e84-8296-062d4af26da3),volume_type_id=9d53d493-ac04-4e84-8296-062d4af26da3)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Creating volume e362faaa-fb66-4b9b-b254-b32626121fc4 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:22:39 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:39 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 1073741824 Jul 05 18:22:39 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2fa10dfc-30ec-4962-9db7-7487836e0679 tempest-SnapshotsActionsTest-2090009758 None] Create snapshot completed successfully Jul 05 18:22:39 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 1073741824" returned: 0 in 0.938s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:40 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 Jul 05 18:22:40 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-quobyte-8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Deleting offline snapshot 8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] snapshot_file for this snap is: volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[118589cc-303d-4454-a444-646d839b923d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Flow 'volume_create_manager' (c84a76c9-0289-42cc-95f2-1822aaeae9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9007105-69fd-41b5-9b1d-5f665f2a38f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:40 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a Jul 05 18:22:40 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9007105-69fd-41b5-9b1d-5f665f2a38f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2056406365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3baab0dc-9c5b-4377-a799-f64d3557b8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a0b010ff4416abcdf227cbe7cfeb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:41Z,use_quota=True,user_id='b716548c37394f929908e800b30d8722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a32c3ab-73ae-484c-adb6-f037ca6452b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a32c3ab-73ae-484c-adb6-f037ca6452b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7b7206-0991-467d-8ad2-5a8fa40ca8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7b7206-0991-467d-8ad2-5a8fa40ca8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3baab0dc-9c5b-4377-a799-f64d3557b8a1', 'volume_name': 'volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6d5997-59fa-473b-be5e-f6b364b8ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e6d5997-59fa-473b-be5e-f6b364b8ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225611f3-bfe3-47c7-a925-c9af0f6a5d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:40 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Volume 3baab0dc-9c5b-4377-a799-f64d3557b8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1', 'volume_size': 1} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:40 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4" returned: 0 in 0.887s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.232s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2056406365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3baab0dc-9c5b-4377-a799-f64d3557b8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='970a0b010ff4416abcdf227cbe7cfeb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:41Z,use_quota=True,user_id='b716548c37394f929908e800b30d8722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Creating volume 3baab0dc-9c5b-4377-a799-f64d3557b8a1 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:22:40 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:40 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 1073741824 Jul 05 18:22:40 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659442af-a99d-4ef8-82e1-b26408d19475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e362faaa-fb66-4b9b-b254-b32626121fc4', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8488640d-9735-413b-8821-dbffbf4539b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:40 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Volume volume-e362faaa-fb66-4b9b-b254-b32626121fc4 (e362faaa-fb66-4b9b-b254-b32626121fc4): created successfully Jul 05 18:22:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8488640d-9735-413b-8821-dbffbf4539b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Flow 'volume_create_manager' (7d692065-0df1-4e58-88aa-2cd7fecdca4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3b874371-d5da-4200-a84d-1a6ed349a877 tempest-GroupSnapshotsTest-2102797949 None] Created volume successfully. Jul 05 18:22:41 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a" returned: 0 in 0.949s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:22:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc800fa-6748-472d-9b5f-7aec7852ad6e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:41 devstack sudo[92565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:22:41 devstack sudo[92565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Flow 'volume_create_manager' (a0c269c7-181d-4ee1-8d9b-e1d02cf7d21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9237240c-698d-4891-a033-29c75b4cdff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9237240c-698d-4891-a033-29c75b4cdff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481905679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e536301-a0c1-4ca9-8c9d-2a3d4a74a3f8,host='devstack@QuobyteHD#QuobyteHD',id=6078b9b8-9b09-4c95-9086-ac94ccecf1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b0cc43a15b4fb6af041d17160366bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:42Z,use_quota=True,user_id='8fde0e3475414d86a4647fb0c170f69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d53d493-ac04-4e84-8296-062d4af26da3),volume_type_id=9d53d493-ac04-4e84-8296-062d4af26da3)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3bba37-df3f-4d5b-b4fd-f1f5a892f555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3bba37-df3f-4d5b-b4fd-f1f5a892f555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:42 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa155e4a-73b6-4398-a40b-7d38829430e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa155e4a-73b6-4398-a40b-7d38829430e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6078b9b8-9b09-4c95-9086-ac94ccecf1dc', 'volume_name': 'volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2e0be9-2bd8-4e93-9f0f-fff97e7f58ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2e0be9-2bd8-4e93-9f0f-fff97e7f58ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b6062f-9929-4e78-9521-33f375be4237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:42 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Volume 6078b9b8-9b09-4c95-9086-ac94ccecf1dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc', 'volume_size': 1} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 1073741824" returned: 0 in 1.315s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:42 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 Jul 05 18:22:42 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:42 devstack sudo[92565]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 1.069s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:22:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:42 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a Jul 05 18:22:42 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:43 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1" returned: 0 in 0.801s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e536301-a0c1-4ca9-8c9d-2a3d4a74a3f8,created_at=2026-07-05T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481905679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e536301-a0c1-4ca9-8c9d-2a3d4a74a3f8,host='devstack@QuobyteHD#QuobyteHD',id=6078b9b8-9b09-4c95-9086-ac94ccecf1dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b0cc43a15b4fb6af041d17160366bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:42Z,use_quota=True,user_id='8fde0e3475414d86a4647fb0c170f69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d53d493-ac04-4e84-8296-062d4af26da3),volume_type_id=9d53d493-ac04-4e84-8296-062d4af26da3)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Creating volume 6078b9b8-9b09-4c95-9086-ac94ccecf1dc {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:22:43 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:43 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc 1073741824 Jul 05 18:22:43 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225611f3-bfe3-47c7-a925-c9af0f6a5d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b21949-bd66-4da6-818f-4899b665f290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:43 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Volume volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 (3baab0dc-9c5b-4377-a799-f64d3557b8a1): created successfully Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b21949-bd66-4da6-818f-4899b665f290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Flow 'volume_create_manager' (c84a76c9-0289-42cc-95f2-1822aaeae9f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:43 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a6a9b3d4-6592-46ed-8bfc-6ca1b05f3def tempest-AttachVolumeTestJSON-985090493 None] Created volume successfully. Jul 05 18:22:43 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a" returned: 0 in 0.969s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:43 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a Jul 05 18:22:43 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:44 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc 1073741824" returned: 0 in 0.893s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:44 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc Jul 05 18:22:44 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:44 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a" returned: 0 in 0.690s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a" released by "_delete_snapshot" :: held 3.800s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" released by "delete_snapshot" :: held 3.840s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Created reservations ['7597d8da-fc9e-4906-a16e-843270131ca9', '6dc5fbf8-63ee-4b4c-9ecb-cceca82a6631', '4a6bc59f-51c7-4691-8802-f0fb9821a5c3', '61b601df-61ba-42a4-977d-da22812cc01b'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:22:44 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Delete snapshot completed successfully. Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bdecfde9-04cc-44b3-bd13-37b678a6a445 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-8de5f05f-1ef3-4c4d-963c-4cfd5b47e55a-delete_snapshot" released by "delete_snapshot" :: held 4.034s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:44 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" returned: 0 in 0.657s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b6062f-9929-4e78-9521-33f375be4237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c811e57c-373e-4fed-a6dd-0637dccef900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:44 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Volume volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc (6078b9b8-9b09-4c95-9086-ac94ccecf1dc): created successfully Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c811e57c-373e-4fed-a6dd-0637dccef900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Flow 'volume_create_manager' (a0c269c7-181d-4ee1-8d9b-e1d02cf7d21c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:44 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4d35a879-425f-4441-b3f2-fe0cf00e656d tempest-GroupSnapshotsTest-2102797949 None] Created volume successfully. Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Creating offline snapshot bb093638-23bd-43aa-8d53-8a2ba9335679 of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:22:45 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[853c2d30-df7c-48cd-9ca3-20f7563b8a94]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:45 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:22:45 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:45 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 0.825s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:22:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:45 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 1G Jul 05 18:22:45 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9d72e23f-7078-4442-930d-3f638f1cdd39 tempest-GroupSnapshotsTest-2102797949 None] Update group completed successfully. Jul 05 18:22:46 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 1G" returned: 0 in 0.958s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:46 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 Jul 05 18:22:46 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-e1c0c699-a610-41de-ae73-49412a8b09b3 req-8ad19cb3-5567-4841-a19e-9547afcd42d9 tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-31746c24-05f0-4c5a-b92a-79222cb567b7 tempest-GroupSnapshotsTest-2102797949 None] Update group completed successfully. Jul 05 18:22:47 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679" returned: 0 in 0.793s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:47 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 is being set with open permissions: ugo+rw Jul 05 18:22:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:47 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 Jul 05 18:22:47 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b71cd2ed-c828-472f-896c-204c113a5c81 tempest-GroupSnapshotsTest-2102797949 None] Update group completed successfully. Jul 05 18:22:48 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679" returned: 0 in 0.734s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.405s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-e1c0c699-a610-41de-ae73-49412a8b09b3 req-8ad19cb3-5567-4841-a19e-9547afcd42d9 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.390s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:48 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc5b5f-6c16-42c3-ac3a-535519891bc2]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-e1c0c699-a610-41de-ae73-49412a8b09b3 req-8ad19cb3-5567-4841-a19e-9547afcd42d9 tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-66e71e08-793c-4aa5-8b3c-29e9dcc6bcdd tempest-SnapshotsActionsTest-2090009758 None] Create snapshot completed successfully Jul 05 18:22:48 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 Jul 05 18:22:48 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:49 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-e1c0c699-a610-41de-ae73-49412a8b09b3 req-8ad19cb3-5567-4841-a19e-9547afcd42d9 tempest-AttachVolumeTestJSON-985090493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1" returned: 0 in 0.784s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-e1c0c699-a610-41de-ae73-49412a8b09b3 req-8ad19cb3-5567-4841-a19e-9547afcd42d9 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.810s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-e1c0c699-a610-41de-ae73-49412a8b09b3 req-8ad19cb3-5567-4841-a19e-9547afcd42d9 tempest-AttachVolumeTestJSON-985090493 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa381f14-5a88-4392-910a-a57461300203', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:22:49 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-e1c0c699-a610-41de-ae73-49412a8b09b3 req-8ad19cb3-5567-4841-a19e-9547afcd42d9 tempest-AttachVolumeTestJSON-985090493 None] attachment_update completed successfully. Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-bb093638-23bd-43aa-8d53-8a2ba9335679-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-bb093638-23bd-43aa-8d53-8a2ba9335679-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-quobyte-bb093638-23bd-43aa-8d53-8a2ba9335679" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-bb093638-23bd-43aa-8d53-8a2ba9335679" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Deleting offline snapshot bb093638-23bd-43aa-8d53-8a2ba9335679 of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] snapshot_file for this snap is: volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c131e5-9dc6-4168-b41b-966e5090bad2]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:49 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 Jul 05 18:22:49 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:49 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-86f01c84-5202-4b67-a4f7-a61d73c675ba tempest-GroupSnapshotsTest-2102797949 None] Update group completed successfully. Jul 05 18:22:50 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679" returned: 0 in 0.828s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:50 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:22:50 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd2711-009b-4403-ace5-3d916feed8e9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:50 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:22:50 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:51 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] GroupSnapshot 43832fcb-d5a6-4073-b8cd-e9c69732574c: creating. Jul 05 18:22:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Group snapshot 43832fcb-d5a6-4073-b8cd-e9c69732574c: creating. {{(pid=86664) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 18:22:51 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 0.977s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:22:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:51 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 Jul 05 18:22:51 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Creating offline snapshot 05a5daaa-b770-44df-b5c8-4e3b792cd68f of volume 6078b9b8-9b09-4c95-9086-ac94ccecf1dc {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:22:51 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[02823390-6fe1-4975-9817-3515076c9f32]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:51 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc Jul 05 18:22:51 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:52 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679" returned: 0 in 0.946s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:52 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679 Jul 05 18:22:52 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:52 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" returned: 0 in 1.081s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:52 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f 1G Jul 05 18:22:52 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:53 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.bb093638-23bd-43aa-8d53-8a2ba9335679" returned: 0 in 0.814s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-bb093638-23bd-43aa-8d53-8a2ba9335679" released by "_delete_snapshot" :: held 3.691s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" released by "delete_snapshot" :: held 3.715s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:53 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Created reservations ['794e98a5-0ca3-44ba-9b37-971f9a6f961c', '1b352bfd-6fc4-4258-90f4-f1ea19d02d30', 'c7dcbda9-cad8-4151-a96c-3f7c3eff49ba', '41643bd5-3570-49c7-97fa-1b2c2595dbcb'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:22:53 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Delete snapshot completed successfully. Jul 05 18:22:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-78976c91-4a57-4b6a-ad88-6e618d92e151 tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-bb093638-23bd-43aa-8d53-8a2ba9335679-delete_snapshot" released by "delete_snapshot" :: held 3.950s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:22:53 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f 1G" returned: 0 in 1.026s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:53 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f Jul 05 18:22:53 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:22:54 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Flow 'volume_create_manager' (7f386b9c-b9de-42d5-a7be-c84ef00d254d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6240dd73-4d03-4667-a342-d426cb699c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f" returned: 0 in 1.014s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:54 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6240dd73-4d03-4667-a342-d426cb699c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-851955922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce20a35-0bf4-4f7d-bf21-15a4f41e7016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25a9b155ec049cbaa5df3eb6452e48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:54Z,use_quota=True,user_id='80dfc9e847d1497a9bed01650fa8ad09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:54 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f Jul 05 18:22:54 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c660f861-677d-4c3f-8e94-5ece13e9b663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c660f861-677d-4c3f-8e94-5ece13e9b663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b9787c-5bbb-48f5-9aaa-cf3ca1e44194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b9787c-5bbb-48f5-9aaa-cf3ca1e44194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce20a35-0bf4-4f7d-bf21-15a4f41e7016', 'volume_name': 'volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17ba361-f9c9-4b48-89c0-b1fe756103d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17ba361-f9c9-4b48-89c0-b1fe756103d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafaff8f-913b-4a80-9060-d8a851e41441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:22:54 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Volume 6ce20a35-0bf4-4f7d-bf21-15a4f41e7016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016', 'volume_size': 1} Jul 05 18:22:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:55 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f" returned: 0 in 0.720s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:55 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.info Jul 05 18:22:55 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:55 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.info" returned: 0 in 0.683s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:55 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:22:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:55 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.info Jul 05 18:22:55 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-f49b4e72-53e6-46ce-afe8-3b9915507dda req-f9bbd569-5906-4f27-b260-d32075bbd21c tempest-AttachVolumeTestJSON-985090493 None] Terminate volume connection completed successfully. Jul 05 18:22:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-f49b4e72-53e6-46ce-afe8-3b9915507dda req-f9bbd569-5906-4f27-b260-d32075bbd21c tempest-AttachVolumeTestJSON-985090493 None] Deleting attachment baa950aa-ee4a-4a98-bf3a-7039ae547d94. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:22:56 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.info" returned: 0 in 0.751s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.386s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:22:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:22:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:22:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Creating offline snapshot 0d093a1e-f5df-460e-a75a-e862f5f079f2 of volume e362faaa-fb66-4b9b-b254-b32626121fc4 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:22:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[24400a4b-a120-42b2-9520-9d64c71cf90c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:22:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:56 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 Jul 05 18:22:56 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:57 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4" returned: 0 in 0.986s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:57 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 1G Jul 05 18:22:57 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:58 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 1G" returned: 0 in 1.061s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e362faaa-fb66-4b9b-b254-b32626121fc4 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:58 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e362faaa-fb66-4b9b-b254-b32626121fc4 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 Jul 05 18:22:58 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:22:58 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-de40d3aa-9524-4b22-83f5-b3ef5a71e925 req-9c9aa1f3-a5fa-4e8b-a6dc-2c859307b6f2 tempest-AttachVolumeTestJSON-985090493 None] Terminate volume connection completed successfully. Jul 05 18:22:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-de40d3aa-9524-4b22-83f5-b3ef5a71e925 req-9c9aa1f3-a5fa-4e8b-a6dc-2c859307b6f2 tempest-AttachVolumeTestJSON-985090493 None] Deleting attachment fa381f14-5a88-4392-910a-a57461300203. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:22:59 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 05 18:22:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e362faaa-fb66-4b9b-b254-b32626121fc4 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2" returned: 0 in 0.799s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:22:59 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:22:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:22:59 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 Jul 05 18:22:59 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:00 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2" returned: 0 in 0.722s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:00 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.info Jul 05 18:23:00 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:01 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.info" returned: 0 in 0.826s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:01 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:01 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.info Jul 05 18:23:01 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:01 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.info" returned: 0 in 0.746s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.225s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.356s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-851955922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce20a35-0bf4-4f7d-bf21-15a4f41e7016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25a9b155ec049cbaa5df3eb6452e48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:22:54Z,use_quota=True,user_id='80dfc9e847d1497a9bed01650fa8ad09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Creating volume 6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:23:01 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:23:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:01 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 1073741824 Jul 05 18:23:01 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ab28b0e0-d07e-4f18-bc02-0e0289d21e51 tempest-GroupSnapshotsTest-2102797949 None] group_snapshot 43832fcb-d5a6-4073-b8cd-e9c69732574c: created successfully Jul 05 18:23:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] group_snapshot 43832fcb-d5a6-4073-b8cd-e9c69732574c: deleting Jul 05 18:23:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] group_snapshot 43832fcb-d5a6-4073-b8cd-e9c69732574c: deleting {{(pid=86664) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:03 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-05a5daaa-b770-44df-b5c8-4e3b792cd68f" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 1073741824" returned: 0 in 1.137s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-05a5daaa-b770-44df-b5c8-4e3b792cd68f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Deleting offline snapshot 05a5daaa-b770-44df-b5c8-4e3b792cd68f of volume 6078b9b8-9b09-4c95-9086-ac94ccecf1dc {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] snapshot_file for this snap is: volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae9eeaf-73a2-4c2f-8e2f-0f78c29cfb24]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:03 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 Jul 05 18:23:03 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:03 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f Jul 05 18:23:03 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:04 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016" returned: 0 in 0.869s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.272s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.073s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafaff8f-913b-4a80-9060-d8a851e41441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6476f857-ab0f-4f6c-a2f2-06f1f78d3368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Creating offline snapshot 1328ac97-de6c-4e2c-b711-ef2376b8095e of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:23:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Volume volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 (6ce20a35-0bf4-4f7d-bf21-15a4f41e7016): created successfully Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6476f857-ab0f-4f6c-a2f2-06f1f78d3368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Flow 'volume_create_manager' (7f386b9c-b9de-42d5-a7be-c84ef00d254d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cd51ec-e3d1-4701-a210-ccc61eb6fa09]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e1e13247-ce85-4c1c-84a6-a836ce610ea8 tempest-AttachVolumeNegativeTest-503091028 None] Created volume successfully. Jul 05 18:23:04 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:04 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f" returned: 0 in 1.272s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:04 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e6b7d5-dba2-448a-bc84-f4e86969e377]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:04 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc Jul 05 18:23:04 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:05 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 1.263s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:05 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e 1G Jul 05 18:23:05 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:05 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" returned: 0 in 1.150s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:05 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f Jul 05 18:23:05 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:06 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f" returned: 0 in 0.894s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:06 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e 1G" returned: 0 in 1.029s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:06 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f Jul 05 18:23:06 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:06 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e Jul 05 18:23:06 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:07 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e" returned: 0 in 0.812s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:07 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e is being set with open permissions: ugo+rw Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:07 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc.05a5daaa-b770-44df-b5c8-4e3b792cd68f" returned: 0 in 0.862s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:07 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e Jul 05 18:23:07 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-05a5daaa-b770-44df-b5c8-4e3b792cd68f" released by "_delete_snapshot" :: held 4.477s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" released by "delete_snapshot" :: held 4.521s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-e362faaa-fb66-4b9b-b254-b32626121fc4" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-e362faaa-fb66-4b9b-b254-b32626121fc4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-0d093a1e-f5df-460e-a75a-e862f5f079f2" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-0d093a1e-f5df-460e-a75a-e862f5f079f2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Deleting offline snapshot 0d093a1e-f5df-460e-a75a-e862f5f079f2 of volume e362faaa-fb66-4b9b-b254-b32626121fc4 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] snapshot_file for this snap is: volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8d0cac-969b-468c-a615-fa44a92796bb]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:07 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 Jul 05 18:23:07 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:08 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e" returned: 0 in 0.880s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.223s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-16f14b8b-d815-4594-bae9-2dc32814612a req-d82bc4f3-cdcc-4895-8a72-1f6ae32d70e4 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-16f14b8b-d815-4594-bae9-2dc32814612a req-d82bc4f3-cdcc-4895-8a72-1f6ae32d70e4 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:08 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-31ef17ba-7683-4ac0-b222-ccb99eaad7b6 tempest-SnapshotsActionsTest-2090009758 None] Create snapshot completed successfully Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4132b85-6c61-4e7d-b42d-deaa0405ff85]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-16f14b8b-d815-4594-bae9-2dc32814612a req-d82bc4f3-cdcc-4895-8a72-1f6ae32d70e4 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:08 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 Jul 05 18:23:08 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:08 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2" returned: 0 in 0.949s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e362faaa-fb66-4b9b-b254-b32626121fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf96d03-7e8a-45f3-bf6a-8459b0cb383a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:08 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 Jul 05 18:23:08 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-1328ac97-de6c-4e2c-b711-ef2376b8095e-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-1328ac97-de6c-4e2c-b711-ef2376b8095e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-quobyte-1328ac97-de6c-4e2c-b711-ef2376b8095e" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-1328ac97-de6c-4e2c-b711-ef2376b8095e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Deleting offline snapshot 1328ac97-de6c-4e2c-b711-ef2376b8095e of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] snapshot_file for this snap is: volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f236d7-e3ab-4fe4-b22e-b521d29d908d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:09 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e Jul 05 18:23:09 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:09 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-16f14b8b-d815-4594-bae9-2dc32814612a req-d82bc4f3-cdcc-4895-8a72-1f6ae32d70e4 tempest-AttachVolumeNegativeTest-503091028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016" returned: 0 in 1.029s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-16f14b8b-d815-4594-bae9-2dc32814612a req-d82bc4f3-cdcc-4895-8a72-1f6ae32d70e4 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.054s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-16f14b8b-d815-4594-bae9-2dc32814612a req-d82bc4f3-cdcc-4895-8a72-1f6ae32d70e4 tempest-AttachVolumeNegativeTest-503091028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '840f4e4c-7426-46de-9722-87c40e221630', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:23:09 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-16f14b8b-d815-4594-bae9-2dc32814612a req-d82bc4f3-cdcc-4895-8a72-1f6ae32d70e4 tempest-AttachVolumeNegativeTest-503091028 None] attachment_update completed successfully. Jul 05 18:23:09 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4" returned: 0 in 1.159s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:09 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 Jul 05 18:23:09 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:10 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e" returned: 0 in 1.141s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12c826e-b11b-4494-a140-938b494160a0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "cinder-3baab0dc-9c5b-4377-a799-f64d3557b8a1-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:10 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:23:10 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-3baab0dc-9c5b-4377-a799-f64d3557b8a1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "cinder-quobyte-3baab0dc-9c5b-4377-a799-f64d3557b8a1" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-quobyte-3baab0dc-9c5b-4377-a799-f64d3557b8a1" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[212be00a-f373-488e-8c65-caa605454882]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:10 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 Jul 05 18:23:10 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:10 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2" returned: 0 in 1.027s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:10 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2 Jul 05 18:23:10 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:11 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 0.988s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:11 devstack sudo[93264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e Jul 05 18:23:11 devstack sudo[93264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:11 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1" returned: 0 in 1.006s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:11 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1 Jul 05 18:23:11 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:11 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4.0d093a1e-f5df-460e-a75a-e862f5f079f2" returned: 0 in 0.741s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-0d093a1e-f5df-460e-a75a-e862f5f079f2" released by "_delete_snapshot" :: held 4.054s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-e362faaa-fb66-4b9b-b254-b32626121fc4" released by "delete_snapshot" :: held 4.087s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:11 devstack cinder-volume[86664]: WARNING cinder.quota [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-876686767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-876686767, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:23:11 devstack cinder-volume[86664]: WARNING cinder.quota [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-876686767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-876686767, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['cf740c26-3757-4334-8833-1a6a49cea51f', '2e101be3-3d52-4260-a789-bb8f010bfccf', '08006e59-ab8e-4048-823f-bb1d507807ed', 'f56e2cea-df37-4f94-9fc4-9d89c4b157ea'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:11 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['aa69e90c-623d-428e-9ac5-3b42f5707da3', 'a7d6db62-5c85-406b-96fd-012ebb6b63cf', '951553b5-2ec0-4fb9-bcd7-4e4f2b4795bb', 'e9e2f6db-5005-487e-8e24-2f7d463d592e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:12 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:23:12 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:12 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ef1a8dd2-f92f-4317-9cbe-c21b5692e52f tempest-GroupSnapshotsTest-2102797949 None] group_snapshot 43832fcb-d5a6-4073-b8cd-e9c69732574c: deleted successfully Jul 05 18:23:12 devstack sudo[93264]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e" returned: 0 in 1.077s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:12 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3baab0dc-9c5b-4377-a799-f64d3557b8a1" returned: 0 in 0.852s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:12 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e Jul 05 18:23:12 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-quobyte-3baab0dc-9c5b-4377-a799-f64d3557b8a1" released by "delete_volume" :: held 1.902s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Created reservations ['56052321-407b-49f3-8d53-e3fae8ce32ad', 'c68d40fe-de81-411e-a2dd-df0446050c24', 'ecf1f89d-bdf9-46f1-a601-44410ed4b293', '5ccfdc78-8a5d-4ed9-8b2a-81d78103cdfd'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:12 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:23:12 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "cinder-78ba10e2-5919-41ba-8ffa-c1e95eb11d02-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-78ba10e2-5919-41ba-8ffa-c1e95eb11d02-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "cinder-quobyte-78ba10e2-5919-41ba-8ffa-c1e95eb11d02" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-quobyte-78ba10e2-5919-41ba-8ffa-c1e95eb11d02" acquired by "delete_volume" :: waited 0.026s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a8fe8-eb58-43ce-b259-72c4fcb5604b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:13 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.958s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 8 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:23:13 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 Jul 05 18:23:13 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:13 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.1328ac97-de6c-4e2c-b711-ef2376b8095e" returned: 0 in 1.032s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-1328ac97-de6c-4e2c-b711-ef2376b8095e" released by "_delete_snapshot" :: held 4.392s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:13 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" released by "delete_snapshot" :: held 4.431s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.899s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:23:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Deleted volume successfully. Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-325f29c1-3ecc-43b5-95fc-9838cbd650eb tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-3baab0dc-9c5b-4377-a799-f64d3557b8a1-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4f5f16-952f-4d7d-80a2-2c5477189cf0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Created reservations ['f6cc10a2-6e8f-4279-888d-042c93bb44b6', 'cdb19ac6-1026-446b-8455-1b77b3d8ffce', '2ca7192e-b419-4335-8c13-568bed07617a', '8fe64e86-8d2c-40fb-82d9-844da9e92a2a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Delete snapshot completed successfully. Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1de27b81-b5ad-4fce-97c8-210055aa503e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-1328ac97-de6c-4e2c-b711-ef2376b8095e-delete_snapshot" released by "delete_snapshot" :: held 4.791s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:13 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc Jul 05 18:23:13 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:13 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02" returned: 0 in 1.021s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:14 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02 Jul 05 18:23:14 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:14 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" returned: 0 in 1.019s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:14 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc Jul 05 18:23:14 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:14 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-78ba10e2-5919-41ba-8ffa-c1e95eb11d02" returned: 0 in 0.872s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-quobyte-78ba10e2-5919-41ba-8ffa-c1e95eb11d02" released by "delete_volume" :: held 1.958s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Creating offline snapshot 022419bd-6551-44ef-af9d-3fdf3036cc6b of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:23:14 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd5efaf-62ac-44c9-8c25-f9294d4323a9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:15 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Created reservations ['8bd207bc-c9ab-4247-b7c9-2f868ada946d', '9cbce02c-5020-444e-9802-ed73f6f2dc62', '0bc4b3dd-d692-490d-8a89-7256a695ab89', '18566e49-53d8-49c1-90b3-9de4f59ef266'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:15 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:23:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:15 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:15 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:23:15 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:16 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" returned: 0 in 1.415s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-6078b9b8-9b09-4c95-9086-ac94ccecf1dc" released by "delete_volume" :: held 2.532s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-e362faaa-fb66-4b9b-b254-b32626121fc4" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-e362faaa-fb66-4b9b-b254-b32626121fc4" acquired by "delete_volume" :: waited 0.044s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fa7670-ea92-4631-b39b-6f7850cd065b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:16 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 1.380s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:16 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b 1G Jul 05 18:23:16 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:16 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 Jul 05 18:23:16 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "cinder-11310e0a-cdf5-430c-b690-3995b430f86d-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:16 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-11310e0a-cdf5-430c-b690-3995b430f86d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.405s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:23:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Deleted volume successfully. Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-893422e7-aa11-4225-8ba5-fcd9e27df1f7 tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-78ba10e2-5919-41ba-8ffa-c1e95eb11d02-delete_volume" released by "delete_volume" :: held 3.889s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "cinder-quobyte-11310e0a-cdf5-430c-b690-3995b430f86d" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-quobyte-11310e0a-cdf5-430c-b690-3995b430f86d" acquired by "delete_volume" :: waited 0.043s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a82ee2-a875-492e-9f0f-eb953bb565aa]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:16 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d Jul 05 18:23:17 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:17 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b 1G" returned: 0 in 1.401s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:17 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4" returned: 0 in 1.494s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:17 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b Jul 05 18:23:17 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:17 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4 Jul 05 18:23:17 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d" returned: 0 in 1.235s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:18 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:18 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d Jul 05 18:23:18 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:18 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e362faaa-fb66-4b9b-b254-b32626121fc4" returned: 0 in 0.995s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-e362faaa-fb66-4b9b-b254-b32626121fc4" released by "delete_volume" :: held 2.622s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:18 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b" returned: 0 in 1.097s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:18 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b is being set with open permissions: ugo+rw Jul 05 18:23:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:18 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b Jul 05 18:23:18 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:18 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['5a3039ca-94b6-48e6-bffc-64699d5ef491'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:19 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-11310e0a-cdf5-430c-b690-3995b430f86d" returned: 0 in 0.929s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-quobyte-11310e0a-cdf5-430c-b690-3995b430f86d" released by "delete_volume" :: held 2.244s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:19 devstack cinder-volume[86664]: WARNING cinder.quota [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-876686767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-876686767, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['62057578-b56e-4250-ac8f-aa157626ff08', 'a5b0260e-39df-4629-a93b-263a8a18ed0b', '8843cad1-3a3e-458d-9b94-c112c0824a6f', '2e66751c-f19b-45d8-b0c2-26bc2f2ccf79'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Created reservations ['a193c21a-6f68-429a-9a53-889bbaf8f5e1', 'c5f2d1b2-abac-4b68-85f7-012556a30e95', 'bf2e947b-9f06-4f00-97ce-70875d23639a', '52638f9a-4f82-45ce-92a5-d264f6008a88'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:19 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:23:19 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['c10a6c42-19ff-4078-9fbc-4af8894d0254', 'f7073318-4eff-4641-859b-8668611848a4', '0b0ad408-03cd-4ab0-990b-3d3dd5391cea', '62493019-5be5-4310-8677-f1555886de77'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:19 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:23:19 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:19 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b" returned: 0 in 0.890s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.910s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:19 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-263a7ab7-12a5-437d-b24d-a212efa655f3 tempest-SnapshotsActionsTest-2090009758 None] Create snapshot completed successfully Jul 05 18:23:20 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.956s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:23:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Deleted volume successfully. Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5325a8c8-3252-4cd1-9613-fc462e4e226c tempest-AttachVolumeTestJSON-985090493 None] Lock "cinder-11310e0a-cdf5-430c-b690-3995b430f86d-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:20 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.168s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:23:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-96d8cdee-bb7b-4399-a776-4fea475a4bbd tempest-GroupSnapshotsTest-2102797949 None] Delete group completed successfully. Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-022419bd-6551-44ef-af9d-3fdf3036cc6b-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-022419bd-6551-44ef-af9d-3fdf3036cc6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Acquiring lock "cinder-quobyte-022419bd-6551-44ef-af9d-3fdf3036cc6b" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-022419bd-6551-44ef-af9d-3fdf3036cc6b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Deleting offline snapshot 022419bd-6551-44ef-af9d-3fdf3036cc6b of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] snapshot_file for this snap is: volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa248026-da26-4a76-9aac-6c8492f49390]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9eb001aa-41fb-4a14-a4ea-8c1aecaa734f tempest-GroupSnapshotsTest-2102797949 None] Group tempest-GroupSnapshotsTest-Group-737131488: creating Jul 05 18:23:20 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b Jul 05 18:23:20 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9eb001aa-41fb-4a14-a4ea-8c1aecaa734f tempest-GroupSnapshotsTest-2102797949 None] Group tempest-GroupSnapshotsTest-Group-737131488: created successfully Jul 05 18:23:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9eb001aa-41fb-4a14-a4ea-8c1aecaa734f tempest-GroupSnapshotsTest-2102797949 None] Create group completed successfully. Jul 05 18:23:21 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b" returned: 0 in 1.019s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:21 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f706e6-1771-4322-804d-30604132465d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:21 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:23:21 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Flow 'volume_create_manager' (0660a421-3f6b-400b-8789-81ba45147934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca122251-db13-474d-be0a-0ecdb47923b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca122251-db13-474d-be0a-0ecdb47923b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-677557342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba5a269d-d144-44a6-bda5-7e110d2f0953,host='devstack@QuobyteHD#QuobyteHD',id=a02d0c41-bb5d-4c45-bc4c-f64371647ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b0cc43a15b4fb6af041d17160366bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:23:23Z,use_quota=True,user_id='8fde0e3475414d86a4647fb0c170f69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c77fcc2-2dde-49b4-b161-a3c851483869),volume_type_id=2c77fcc2-2dde-49b4-b161-a3c851483869)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28c86ad-c8a0-4783-b6eb-8cf0b99741fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e28c86ad-c8a0-4783-b6eb-8cf0b99741fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ff4886-d53b-412f-a357-de7c6f9469cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ff4886-d53b-412f-a357-de7c6f9469cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a02d0c41-bb5d-4c45-bc4c-f64371647ab2', 'volume_name': 'volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee04d49-a2ee-4739-9f8f-14f6cb776e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee04d49-a2ee-4739-9f8f-14f6cb776e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b316fe-53e0-41fd-b02c-c26fd1b8a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:22 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Volume a02d0c41-bb5d-4c45-bc4c-f64371647ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2', 'volume_size': 1} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ba5a269d-d144-44a6-bda5-7e110d2f0953,created_at=2026-07-05T16:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-677557342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba5a269d-d144-44a6-bda5-7e110d2f0953,host='devstack@QuobyteHD#QuobyteHD',id=a02d0c41-bb5d-4c45-bc4c-f64371647ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b0cc43a15b4fb6af041d17160366bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:23:23Z,use_quota=True,user_id='8fde0e3475414d86a4647fb0c170f69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c77fcc2-2dde-49b4-b161-a3c851483869),volume_type_id=2c77fcc2-2dde-49b4-b161-a3c851483869)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Creating volume a02d0c41-bb5d-4c45-bc4c-f64371647ab2 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:23:22 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:23:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:22 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 1073741824 Jul 05 18:23:22 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:22 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 1.175s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:23 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b Jul 05 18:23:23 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:24 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b" returned: 0 in 1.026s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:24 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 1073741824" returned: 0 in 1.118s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:24 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b Jul 05 18:23:24 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:24 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=146,cinder:UPDATE=148,cinder:DELETE=9,cinder:INSERT=35 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:23:24 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=134,cinder:INSERT=29,cinder:UPDATE=123,cinder:DELETE=5 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:23:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:24 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 Jul 05 18:23:24 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:24 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.022419bd-6551-44ef-af9d-3fdf3036cc6b" returned: 0 in 0.961s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-022419bd-6551-44ef-af9d-3fdf3036cc6b" released by "_delete_snapshot" :: held 4.310s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" released by "delete_snapshot" :: held 4.337s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:25 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" returned: 0 in 0.984s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b316fe-53e0-41fd-b02c-c26fd1b8a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8029d6a3-f660-4ee0-b028-ff5ea9f0a310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:25 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Volume volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 (a02d0c41-bb5d-4c45-bc4c-f64371647ab2): created successfully Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8029d6a3-f660-4ee0-b028-ff5ea9f0a310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Flow 'volume_create_manager' (0660a421-3f6b-400b-8789-81ba45147934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Created reservations ['20582564-e33e-4ce6-8372-959d2ef6d083', '404d3480-980b-45a0-90d9-d6bafabe1daf', '5b5bb6ff-7711-47de-811f-04d5121c6106', 'f0116ad8-8727-4745-8bda-48b5e6382a54'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5f1ea380-24f1-4c33-8455-4b8691eee0f2 tempest-GroupSnapshotsTest-2102797949 None] Created volume successfully. Jul 05 18:23:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Delete snapshot completed successfully. Jul 05 18:23:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2957ae4-316c-4be9-a4a5-7a2ce4e32d2e tempest-SnapshotsActionsTest-1390400184 None] Lock "cinder-022419bd-6551-44ef-af9d-3fdf3036cc6b-delete_snapshot" released by "delete_snapshot" :: held 4.665s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "cinder-44d334bd-14f2-44ca-86c0-b3779ee3f77d-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-44d334bd-14f2-44ca-86c0-b3779ee3f77d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "cinder-quobyte-44d334bd-14f2-44ca-86c0-b3779ee3f77d" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-quobyte-44d334bd-14f2-44ca-86c0-b3779ee3f77d" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Deleting offline snapshot 44d334bd-14f2-44ca-86c0-b3779ee3f77d of volume ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:23:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] snapshot_file for this snap is: volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:23:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1245e54d-05e6-4b51-bb2c-390e156ba2d6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:27 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:23:27 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] GroupSnapshot ade6233d-1a11-4511-9e94-6c6b79358734: creating. Jul 05 18:23:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Group snapshot ade6233d-1a11-4511-9e94-6c6b79358734: creating. {{(pid=86664) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 18:23:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Creating offline snapshot db7105d2-9b06-404d-a80e-f4c13ec7d7d8 of volume a02d0c41-bb5d-4c45-bc4c-f64371647ab2 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:23:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9524ad53-db77-45fe-997e-e35fec6f9280]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:27 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 Jul 05 18:23:27 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:28 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 1.530s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:28 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dd58fc-9a47-4acf-ad25-652753614cce]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:28 devstack sudo[93417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 Jul 05 18:23:28 devstack sudo[93417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:29 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" returned: 0 in 1.430s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:29 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 1G Jul 05 18:23:29 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:29 devstack sudo[93417]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" returned: 0 in 1.057s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:29 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:23:29 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:30 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 1G" returned: 0 in 1.239s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:30 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 Jul 05 18:23:30 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:30 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 0.957s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:30 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d Jul 05 18:23:30 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:31 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8" returned: 0 in 0.979s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:31 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:31 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 Jul 05 18:23:31 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Flow 'volume_create_manager' (861383fb-921f-45ff-b371-6e2cd0447e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e2df2f-9ee4-4c0a-bbbb-4dfeba009e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e2df2f-9ee4-4c0a-bbbb-4dfeba009e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1402682262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6859754-e8e9-43dc-9db9-ceb047d3213a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9f04b4b1cd8430996d8b81d11575b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:23:31Z,use_quota=True,user_id='286654f1fbea4354ad2717f276d6acb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e75c266-766a-425d-b4d6-0dabb6d872a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e75c266-766a-425d-b4d6-0dabb6d872a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb4710d-f6d3-4939-88f7-e1d182699512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb4710d-f6d3-4939-88f7-e1d182699512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6859754-e8e9-43dc-9db9-ceb047d3213a', 'volume_name': 'volume-d6859754-e8e9-43dc-9db9-ceb047d3213a', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7858463-3452-4344-80b7-22c93c7c565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7858463-3452-4344-80b7-22c93c7c565c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9aabdb4-e842-4a0e-87a8-14e42acad24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:31 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Volume d6859754-e8e9-43dc-9db9-ceb047d3213a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6859754-e8e9-43dc-9db9-ceb047d3213a', 'volume_size': 1} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:31 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51.44d334bd-14f2-44ca-86c0-b3779ee3f77d" returned: 0 in 0.991s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-quobyte-44d334bd-14f2-44ca-86c0-b3779ee3f77d" released by "_delete_snapshot" :: held 4.780s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" released by "delete_snapshot" :: held 4.839s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Created reservations ['6f9fc38f-a88e-4b73-bc4c-e93cb61e6665', '6b3c672f-26c3-4247-ae2a-ef1e08c32156', 'fedbe4eb-23de-486c-a18b-c43253debdbb', '56638775-1395-4e4a-95c8-15c1e941cccd'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:31 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Delete snapshot completed successfully. Jul 05 18:23:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c91ecbbe-9d15-4206-be64-3045004993bc tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-44d334bd-14f2-44ca-86c0-b3779ee3f77d-delete_snapshot" released by "delete_snapshot" :: held 5.064s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:32 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8" returned: 0 in 0.888s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:32 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.info Jul 05 18:23:32 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "cinder-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:32 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e820df4-b6ce-42f4-a91c-aa502b2f7d4f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:32 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 Jul 05 18:23:32 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:33 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.info" returned: 0 in 0.886s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:33 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:33 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.info Jul 05 18:23:33 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:33 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" returned: 0 in 1.110s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:33 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51 Jul 05 18:23:33 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:33 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.info" returned: 0 in 0.853s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.430s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.400s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1402682262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6859754-e8e9-43dc-9db9-ceb047d3213a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9f04b4b1cd8430996d8b81d11575b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:23:31Z,use_quota=True,user_id='286654f1fbea4354ad2717f276d6acb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Creating volume d6859754-e8e9-43dc-9db9-ceb047d3213a {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:23:33 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:23:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:33 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a 1073741824 Jul 05 18:23:33 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:34 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-828e9f28-f81f-4ec7-9609-094be532cf66 tempest-GroupSnapshotsTest-2102797949 None] group_snapshot ade6233d-1a11-4511-9e94-6c6b79358734: created successfully Jul 05 18:23:34 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" returned: 0 in 0.762s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-quobyte-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51" released by "delete_volume" :: held 1.962s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:34 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Created reservations ['9b3ba730-893f-4ba9-ae00-462cf9c22000', '55277198-9467-4a2e-a378-2e84fc8099fa', '9869e107-5e0c-4751-865c-f35c519770b9', '8d3bf74b-c0e3-407c-943d-4dd9d212e3f0'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:34 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:23:34 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:35 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a 1073741824" returned: 0 in 1.262s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] group_snapshot ade6233d-1a11-4511-9e94-6c6b79358734: deleting Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] group_snapshot ade6233d-1a11-4511-9e94-6c6b79358734: deleting {{(pid=86664) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:35 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a Jul 05 18:23:35 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-db7105d2-9b06-404d-a80e-f4c13ec7d7d8" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-db7105d2-9b06-404d-a80e-f4c13ec7d7d8" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Deleting offline snapshot db7105d2-9b06-404d-a80e-f4c13ec7d7d8 of volume a02d0c41-bb5d-4c45-bc4c-f64371647ab2 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] snapshot_file for this snap is: volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[59528913-ebb3-4adf-979b-ea9361485f49]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:35 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.256s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:23:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Deleted volume successfully. Jul 05 18:23:35 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 Jul 05 18:23:35 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab0e7bc6-f8b7-4dc9-ba68-d6d7b2e74bed tempest-SnapshotsActionsTest-2090009758 None] Lock "cinder-ec08b9e3-c62e-4422-8dd4-b211d2f5eb51-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:36 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a" returned: 0 in 0.978s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] <== create_volume: return (2415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.420s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9aabdb4-e842-4a0e-87a8-14e42acad24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6859754-e8e9-43dc-9db9-ceb047d3213a', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e1434b-6d53-4a00-9aac-38ee571bf834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:36 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Volume volume-d6859754-e8e9-43dc-9db9-ceb047d3213a (d6859754-e8e9-43dc-9db9-ceb047d3213a): created successfully Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e1434b-6d53-4a00-9aac-38ee571bf834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Flow 'volume_create_manager' (861383fb-921f-45ff-b371-6e2cd0447e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:36 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-ac6dde0c-54cc-418e-86ad-0d8943c4f502 req-8c09898c-a514-4f15-82b8-6c01fa62cba4 tempest-VolumesGetTestJSON-56048529 None] Created volume successfully. Jul 05 18:23:36 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8" returned: 0 in 1.225s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc79b665-d1e0-4d95-bb78-3c0c736430a5]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:37 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 Jul 05 18:23:37 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Acquiring lock "cinder-d6859754-e8e9-43dc-9db9-ceb047d3213a-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Lock "cinder-d6859754-e8e9-43dc-9db9-ceb047d3213a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Acquiring lock "cinder-quobyte-d6859754-e8e9-43dc-9db9-ceb047d3213a" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Lock "cinder-quobyte-d6859754-e8e9-43dc-9db9-ceb047d3213a" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb693f8-8fcf-4965-9d32-2a4144db3e59]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:38 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a Jul 05 18:23:38 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:38 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" returned: 0 in 1.393s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:38 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 Jul 05 18:23:38 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:39 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a" returned: 0 in 1.400s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:39 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a Jul 05 18:23:39 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:40 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8" returned: 0 in 1.851s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:40 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8 Jul 05 18:23:40 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:40 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d6859754-e8e9-43dc-9db9-ceb047d3213a" returned: 0 in 1.150s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Lock "cinder-quobyte-d6859754-e8e9-43dc-9db9-ceb047d3213a" released by "delete_volume" :: held 2.637s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG cinder.quota [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Created reservations ['8b0a1981-9f53-45cb-beeb-c4c05b888530', '02033283-9a90-472e-9f0c-063bf0073f60', 'd51454e0-ebe2-41e5-8dc6-096d633045a7', '5758f281-eedf-4f5f-912f-3338e1e5c35e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:41 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:23:41 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:41 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2.db7105d2-9b06-404d-a80e-f4c13ec7d7d8" returned: 0 in 1.179s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-db7105d2-9b06-404d-a80e-f4c13ec7d7d8" released by "_delete_snapshot" :: held 5.883s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" released by "delete_snapshot" :: held 5.943s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:41 devstack cinder-volume[86664]: WARNING cinder.quota [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-721263553 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-721263553, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:23:41 devstack cinder-volume[86664]: WARNING cinder.quota [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-721263553 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-721263553, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:23:41 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['ff7faf87-1641-4943-b3e3-1a6acd3fa847', '03bb24d8-5ff8-4992-8059-8a731c9a056f', 'ad972598-14c9-4cd1-b840-6ef1f5f7aad0', '93f15e6b-4560-4eba-8f4f-5e9e35bfb80b'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8e498f76-bcf9-466e-81b4-f12ecc312754 tempest-GroupSnapshotsTest-2102797949 None] group_snapshot ade6233d-1a11-4511-9e94-6c6b79358734: deleted successfully Jul 05 18:23:42 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.269s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:42 devstack cinder-volume[86664]: DEBUG cinder.manager [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:23:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Deleted volume successfully. Jul 05 18:23:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-78be0114-1c6c-4de7-b343-6a0f9d6190d9 req-c5ec5cbc-ab51-4a64-9614-9ba56d303b52 tempest-VolumesGetTestJSON-56048529 None] Lock "cinder-d6859754-e8e9-43dc-9db9-ceb047d3213a-delete_volume" released by "delete_volume" :: held 4.449s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "cinder-quobyte-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" acquired by "delete_volume" :: waited 0.050s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:42 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c14f1e-f834-43f2-acb5-451072bde27b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:42 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 Jul 05 18:23:42 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:43 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" returned: 0 in 1.079s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:43 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2 Jul 05 18:23:43 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:44 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" returned: 0 in 0.879s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Lock "cinder-quobyte-a02d0c41-bb5d-4c45-bc4c-f64371647ab2" released by "delete_volume" :: held 2.066s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['b88fb47d-c7ae-477b-ac33-85fea23dc1f0'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:44 devstack cinder-volume[86664]: WARNING cinder.quota [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-721263553 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-721263553, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Created reservations ['7f20f45d-236e-44ac-b2d2-54d6c572b6db', 'cc3d1f8f-7d53-4acb-89f0-1e25b9557473', '03d8d2a7-cebe-4b18-8fdd-8c86edb42ad7', 'd935f637-5174-41b8-9792-284fcf3c2e88'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:45 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:23:45 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:45 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.020s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:45 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:23:46 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d6da9e71-2cfb-432e-9c73-ccfea14569cb tempest-GroupSnapshotsTest-2102797949 None] Delete group completed successfully. Jul 05 18:23:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ba7882c1-cc6d-48bb-bc02-70c0488e7c1d tempest-BackendsCapabilitiesAdminTestsJSON-1579619160 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7357330322266, 'free_capacity_gb': 1775.7357330322266, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86664) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 18:23:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cbdae32-00f5-4008-bfcc-f04b9509d6f3 tempest-BackendsCapabilitiesAdminTestsJSON-1579619160 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7357330322266, 'free_capacity_gb': 1775.7357330322266, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86664) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Flow 'volume_create_manager' (990c4771-53f8-41a2-8199-023900745536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a38244-1d00-41ab-a0e8-bdf73a6d50c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a38244-1d00-41ab-a0e8-bdf73a6d50c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1688206163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f68615-103d-4de1-bf79-2911e6d52fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145bee15d86043aebbdfeb48ce5bf92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:23:53Z,use_quota=True,user_id='3abfd56a1eaa45dda3e97c2dca17e57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36415ab7-602c-4504-a594-7e052a072386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36415ab7-602c-4504-a594-7e052a072386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4665360-f224-42dd-96bb-357fa6df0003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4665360-f224-42dd-96bb-357fa6df0003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f68615-103d-4de1-bf79-2911e6d52fc4', 'volume_name': 'volume-53f68615-103d-4de1-bf79-2911e6d52fc4', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7f1f0d-76f4-49f4-81db-49807bd6ea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7f1f0d-76f4-49f4-81db-49807bd6ea04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92680a09-eefa-4e73-9a7d-378d8ad0c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:53 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Volume 53f68615-103d-4de1-bf79-2911e6d52fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f68615-103d-4de1-bf79-2911e6d52fc4', 'volume_size': 1} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1688206163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f68615-103d-4de1-bf79-2911e6d52fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145bee15d86043aebbdfeb48ce5bf92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:23:53Z,use_quota=True,user_id='3abfd56a1eaa45dda3e97c2dca17e57d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Creating volume 53f68615-103d-4de1-bf79-2911e6d52fc4 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:23:53 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:23:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:53 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4 1073741824 Jul 05 18:23:53 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:53 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ed793f49-545d-48c3-b439-a8b9706d6eee tempest-GroupsV314Test-682306130 None] Group tempest-GroupsV314Test-Group-1692366671: creating Jul 05 18:23:53 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ed793f49-545d-48c3-b439-a8b9706d6eee tempest-GroupsV314Test-682306130 None] Group tempest-GroupsV314Test-Group-1692366671: created successfully Jul 05 18:23:53 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ed793f49-545d-48c3-b439-a8b9706d6eee tempest-GroupsV314Test-682306130 None] Create group completed successfully. Jul 05 18:23:54 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4 1073741824" returned: 0 in 1.065s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:54 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4 Jul 05 18:23:54 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:55 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4" returned: 0 in 0.846s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92680a09-eefa-4e73-9a7d-378d8ad0c73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f68615-103d-4de1-bf79-2911e6d52fc4', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17400694-8684-493c-9847-118823bfc680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:55 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Volume volume-53f68615-103d-4de1-bf79-2911e6d52fc4 (53f68615-103d-4de1-bf79-2911e6d52fc4): created successfully Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17400694-8684-493c-9847-118823bfc680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Flow 'volume_create_manager' (990c4771-53f8-41a2-8199-023900745536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:55 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-38a8e388-9a07-49e6-b13a-0eeb639773e5 tempest-VolumesServicesTestJSON-1871227967 None] Created volume successfully. Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Flow 'volume_create_manager' (74e35877-0440-4376-843f-f3b32ea8d65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a61799-7693-4f0d-bb37-af72567e3f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a61799-7693-4f0d-bb37-af72567e3f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1373529671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb7d1071-f9b4-426e-8a99-72c31d3b2c1d,host='devstack@QuobyteHD#QuobyteHD',id=055b8376-ef85-4e13-bc24-3d0342c1b773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf3f36d12f64cc5898ad323465fe13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:23:56Z,use_quota=True,user_id='4debdd15e00c45ce8b2964f99b794682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efd4d2b3-79e0-4e21-9e04-8a2b653d3bf1),volume_type_id=efd4d2b3-79e0-4e21-9e04-8a2b653d3bf1)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ce55b9-23ec-46ae-bc82-9c2410f120ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ce55b9-23ec-46ae-bc82-9c2410f120ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb74dd5-d799-492e-bd60-b271c6db27da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb74dd5-d799-492e-bd60-b271c6db27da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055b8376-ef85-4e13-bc24-3d0342c1b773', 'volume_name': 'volume-055b8376-ef85-4e13-bc24-3d0342c1b773', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cbc46d-b89b-43e2-96f0-e03a4844f7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cbc46d-b89b-43e2-96f0-e03a4844f7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490a55e9-9c0c-4d02-8e51-ccf5345a52a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:55 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Volume 055b8376-ef85-4e13-bc24-3d0342c1b773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055b8376-ef85-4e13-bc24-3d0342c1b773', 'volume_size': 1} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cb7d1071-f9b4-426e-8a99-72c31d3b2c1d,created_at=2026-07-05T16:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1373529671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb7d1071-f9b4-426e-8a99-72c31d3b2c1d,host='devstack@QuobyteHD#QuobyteHD',id=055b8376-ef85-4e13-bc24-3d0342c1b773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf3f36d12f64cc5898ad323465fe13e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:23:56Z,use_quota=True,user_id='4debdd15e00c45ce8b2964f99b794682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efd4d2b3-79e0-4e21-9e04-8a2b653d3bf1),volume_type_id=efd4d2b3-79e0-4e21-9e04-8a2b653d3bf1)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Creating volume 055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:23:55 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:23:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:55 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 1073741824 Jul 05 18:23:55 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Acquiring lock "cinder-53f68615-103d-4de1-bf79-2911e6d52fc4-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Lock "cinder-53f68615-103d-4de1-bf79-2911e6d52fc4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Acquiring lock "cinder-quobyte-53f68615-103d-4de1-bf79-2911e6d52fc4" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:23:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Lock "cinder-quobyte-53f68615-103d-4de1-bf79-2911e6d52fc4" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:23:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d289e7-45f4-4caa-9827-f6aa49cee201]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:23:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:57 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 1073741824" returned: 0 in 1.411s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3130d176-ea53-4e53-bcd2-ef49bb3d3e2d tempest-GroupSnapshotsV319Test-887516817 None] Group tempest-GroupSnapshotsV319Test-Group-885392700: creating Jul 05 18:23:57 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 Jul 05 18:23:57 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:57 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4 Jul 05 18:23:57 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3130d176-ea53-4e53-bcd2-ef49bb3d3e2d tempest-GroupSnapshotsV319Test-887516817 None] Group tempest-GroupSnapshotsV319Test-Group-885392700: created successfully Jul 05 18:23:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3130d176-ea53-4e53-bcd2-ef49bb3d3e2d tempest-GroupSnapshotsV319Test-887516817 None] Create group completed successfully. Jul 05 18:23:58 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773" returned: 0 in 0.857s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:23:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490a55e9-9c0c-4d02-8e51-ccf5345a52a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055b8376-ef85-4e13-bc24-3d0342c1b773', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f36917-fe53-45f0-a8c5-7d1ad8039f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Volume volume-055b8376-ef85-4e13-bc24-3d0342c1b773 (055b8376-ef85-4e13-bc24-3d0342c1b773): created successfully Jul 05 18:23:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f36917-fe53-45f0-a8c5-7d1ad8039f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Flow 'volume_create_manager' (74e35877-0440-4376-843f-f3b32ea8d65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:58 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4" returned: 0 in 1.135s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:58 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0f308a5b-d326-4245-a6f0-14dcaa2e392f tempest-GroupsV314Test-682306130 None] Created volume successfully. Jul 05 18:23:58 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4 Jul 05 18:23:58 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:59 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-53f68615-103d-4de1-bf79-2911e6d52fc4" returned: 0 in 0.766s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Lock "cinder-quobyte-53f68615-103d-4de1-bf79-2911e6d52fc4" released by "delete_volume" :: held 1.983s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Created reservations ['02468092-91c3-4331-906b-42f8e50ba22c', '6d25f0ae-4493-4f77-8d6d-1fb0289bc748', 'bc6e49f6-d75e-4762-8381-cb6b276623b5', 'e47d0e7a-412c-4a79-a1cd-cc26fb1e26c2'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:59 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:23:59 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Flow 'volume_create_manager' (e62cafbe-917a-47c8-8d7f-ae7d230edc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64a9bd7-38a2-45fa-9788-bbc6b49cdd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64a9bd7-38a2-45fa-9788-bbc6b49cdd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1626527556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5bfa43f-8f1b-43ea-8513-af16438e68d3,host='devstack@QuobyteHD#QuobyteHD',id=3833c834-76ea-43a6-9916-74bde2948361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76942ca625d4c1787532fc088d74ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:24:00Z,use_quota=True,user_id='7902bf2c0b5146dca3225ba6ae3bcaab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61909d44-47fb-4ab4-aaed-7201a9d10573),volume_type_id=61909d44-47fb-4ab4-aaed-7201a9d10573)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac3f613-3eff-4a4d-a08d-bc6ce8d4fc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bac3f613-3eff-4a4d-a08d-bc6ce8d4fc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99fd7a0-1c84-49d3-a671-fc35b74449ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99fd7a0-1c84-49d3-a671-fc35b74449ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3833c834-76ea-43a6-9916-74bde2948361', 'volume_name': 'volume-3833c834-76ea-43a6-9916-74bde2948361', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81b26fa-36b8-4fb2-9de7-7d2ae69f78e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81b26fa-36b8-4fb2-9de7-7d2ae69f78e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7ff9d7-9e57-4481-be9d-3ad5a7002850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:23:59 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Volume 3833c834-76ea-43a6-9916-74bde2948361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3833c834-76ea-43a6-9916-74bde2948361', 'volume_size': 1} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f5bfa43f-8f1b-43ea-8513-af16438e68d3,created_at=2026-07-05T16:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1626527556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5bfa43f-8f1b-43ea-8513-af16438e68d3,host='devstack@QuobyteHD#QuobyteHD',id=3833c834-76ea-43a6-9916-74bde2948361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76942ca625d4c1787532fc088d74ab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:24:00Z,use_quota=True,user_id='7902bf2c0b5146dca3225ba6ae3bcaab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61909d44-47fb-4ab4-aaed-7201a9d10573),volume_type_id=61909d44-47fb-4ab4-aaed-7201a9d10573)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Creating volume 3833c834-76ea-43a6-9916-74bde2948361 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:23:59 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:23:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:23:59 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 1073741824 Jul 05 18:23:59 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:00 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.939s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:00 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:24:00 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Deleted volume successfully. Jul 05 18:24:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f0fed551-5bd0-4239-808e-1c3ec090e15b tempest-VolumesServicesTestJSON-1871227967 None] Lock "cinder-53f68615-103d-4de1-bf79-2911e6d52fc4-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:24:00 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 1073741824" returned: 0 in 1.175s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:00 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 Jul 05 18:24:00 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:01 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361" returned: 0 in 0.883s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.741s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:01 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Cloning volume 055b8376-ef85-4e13-bc24-3d0342c1b773 to volume 287e139d-330d-43b7-b4d3-6d3d69db2d4c Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7ff9d7-9e57-4481-be9d-3ad5a7002850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3833c834-76ea-43a6-9916-74bde2948361', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecf4f5e-3b5b-42ce-ac3b-339f35254810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:01 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Volume volume-3833c834-76ea-43a6-9916-74bde2948361 (3833c834-76ea-43a6-9916-74bde2948361): created successfully Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecf4f5e-3b5b-42ce-ac3b-339f35254810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Flow 'volume_create_manager' (e62cafbe-917a-47c8-8d7f-ae7d230edc37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Creating offline snapshot 58838db8-235a-4ad9-b1f0-056d9b6e8306 of volume 055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:24:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ce6b22f7-090c-471a-b119-ae2bb7f16b38 tempest-GroupSnapshotsV319Test-887516817 None] Created volume successfully. Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7271790f-c3c2-4ba7-bc55-915f8bc60f79]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:02 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 Jul 05 18:24:02 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] GroupSnapshot 03ecf3b7-fdc9-4afc-a432-0570571f1f8d: creating. Jul 05 18:24:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Group snapshot 03ecf3b7-fdc9-4afc-a432-0570571f1f8d: creating. {{(pid=86664) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 05 18:24:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:02 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773" returned: 0 in 1.015s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:02 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 1G Jul 05 18:24:02 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:04 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 1G" returned: 0 in 1.397s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055b8376-ef85-4e13-bc24-3d0342c1b773 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:04 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055b8376-ef85-4e13-bc24-3d0342c1b773 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 Jul 05 18:24:04 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:05 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055b8376-ef85-4e13-bc24-3d0342c1b773 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306" returned: 0 in 1.022s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:05 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:24:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:05 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 Jul 05 18:24:05 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:06 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306" returned: 0 in 0.813s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:06 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.info Jul 05 18:24:06 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:06 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.info" returned: 0 in 0.775s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:06 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:24:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:07 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.info Jul 05 18:24:07 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:07 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.info" returned: 0 in 0.807s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Acquiring lock "cinder-quobyte-287e139d-330d-43b7-b4d3-6d3d69db2d4c" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Lock "cinder-quobyte-287e139d-330d-43b7-b4d3-6d3d69db2d4c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] snapshot: 58838db8-235a-4ad9-b1f0-056d9b6e8306, volume: 287e139d-330d-43b7-b4d3-6d3d69db2d4c, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de473d3-f7d4-482f-a023-40061eec4060]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:08 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 Jul 05 18:24:08 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:08 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306" returned: 0 in 1.091s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-055b8376-ef85-4e13-bc24-3d0342c1b773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:24:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:24:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:24:08 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[def03479-0289-49d6-861c-dbaa73e9121b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:09 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 Jul 05 18:24:09 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:09 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773" returned: 0 in 1.005s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:10 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:24:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:10 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c Jul 05 18:24:10 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:24:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:24:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:24:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:12 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:24:12 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:13 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.648s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:24:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:24:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 8 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:24:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:24:14 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-400c06ae-0ccf-4ad9-be50-93a77b1bdf9d req-5ca45a29-c597-4363-b680-49852d118e14 tempest-AttachVolumeNegativeTest-503091028 None] Terminate volume connection completed successfully. Jul 05 18:24:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-400c06ae-0ccf-4ad9-be50-93a77b1bdf9d req-5ca45a29-c597-4363-b680-49852d118e14 tempest-AttachVolumeNegativeTest-503091028 None] Deleting attachment 840f4e4c-7426-46de-9722-87c40e221630. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:24:16 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c" returned: 0 in 6.601s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0c1203-504e-43cb-9671-9d21df50b57f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:16 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 Jul 05 18:24:16 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:17 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773" returned: 0 in 1.095s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:17 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:24:17 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Converted 1024.00 MB image at 155.09 MB/s Jul 05 18:24:17 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:24:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:17 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c Jul 05 18:24:17 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:18 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c" returned: 0 in 0.882s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Lock "cinder-quobyte-287e139d-330d-43b7-b4d3-6d3d69db2d4c" released by "_copy_volume_from_snapshot" :: held 10.796s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:24:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Acquiring lock "cinder-quobyte-58838db8-235a-4ad9-b1f0-056d9b6e8306" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:24:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Lock "cinder-quobyte-58838db8-235a-4ad9-b1f0-056d9b6e8306" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:24:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Deleting offline snapshot 58838db8-235a-4ad9-b1f0-056d9b6e8306 of volume 055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:24:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] snapshot_file for this snap is: volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:24:18 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[968f8965-bc83-4195-9390-f520aa192328]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:19 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 Jul 05 18:24:19 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:19 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306" returned: 0 in 1.220s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-055b8376-ef85-4e13-bc24-3d0342c1b773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:24:20 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[848c7dfc-2e7e-403d-8bef-dd17f62989f1]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:20 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 Jul 05 18:24:20 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:21 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773" returned: 0 in 1.322s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:21 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 Jul 05 18:24:21 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:22 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306" returned: 0 in 1.020s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:22 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306 Jul 05 18:24:22 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:23 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773.58838db8-235a-4ad9-b1f0-056d9b6e8306" returned: 0 in 0.812s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Lock "cinder-quobyte-58838db8-235a-4ad9-b1f0-056d9b6e8306" released by "_delete_snapshot" :: held 4.510s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:24:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.428s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 20.682s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Creating offline snapshot 7353e983-bb9b-4795-9a23-03f23c2d034c of volume 3833c834-76ea-43a6-9916-74bde2948361 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:24:23 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44b6de6-bd6c-4908-8d1e-dadd1e04de86]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:23 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ed463207-6ed5-453e-8dd6-c348d967ab72 tempest-GroupsV314Test-682306130 None] Create group from source-group-cb7d1071-f9b4-426e-8a99-72c31d3b2c1d completed successfully. Jul 05 18:24:23 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 Jul 05 18:24:23 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:24 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361" returned: 0 in 1.062s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:24 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c 1G Jul 05 18:24:24 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:24 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=67,cinder:INSERT=16,cinder:UPDATE=77,cinder:DELETE=5 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:24:24 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=69,cinder:INSERT=21,cinder:UPDATE=71,cinder:DELETE=3 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:24:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Acquiring lock "cinder-quobyte-287e139d-330d-43b7-b4d3-6d3d69db2d4c" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:24:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Lock "cinder-quobyte-287e139d-330d-43b7-b4d3-6d3d69db2d4c" acquired by "delete_volume" :: waited 0.048s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:24:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a921d148-d8d1-4b9a-aad3-3e0851f0da9f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:25 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c Jul 05 18:24:25 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:25 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c 1G" returned: 0 in 1.407s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3833c834-76ea-43a6-9916-74bde2948361 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:25 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3833c834-76ea-43a6-9916-74bde2948361 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c Jul 05 18:24:25 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:26 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c" returned: 0 in 1.117s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:26 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c Jul 05 18:24:26 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:26 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3833c834-76ea-43a6-9916-74bde2948361 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c" returned: 0 in 1.157s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:26 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:24:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:26 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c Jul 05 18:24:26 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:27 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-287e139d-330d-43b7-b4d3-6d3d69db2d4c" returned: 0 in 1.144s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Lock "cinder-quobyte-287e139d-330d-43b7-b4d3-6d3d69db2d4c" released by "delete_volume" :: held 2.350s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Created reservations ['bda781be-0e9b-4cb5-9116-fd1ef028a3d5'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:24:27 devstack cinder-volume[86664]: WARNING cinder.quota [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1778805044 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1778805044, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:24:27 devstack cinder-volume[86664]: WARNING cinder.quota [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1778805044 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1778805044, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Created reservations ['a29faaf5-abee-45fd-8499-d358fa8544ee', '7b18e21e-838a-46fb-877f-db516732678b', 'ef675b75-0f01-4cbd-8cdf-26481d047e1c', 'c4b05962-cc7f-40ad-89ec-e7f4846c4f47'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:27 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:24:27 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:27 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c" returned: 0 in 1.020s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:28 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.info Jul 05 18:24:28 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:28 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.076s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:28 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:24:28 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-51e83592-e5f5-4d2f-98f1-496e0ffbd996 tempest-GroupsV314Test-682306130 None] Delete group completed successfully. Jul 05 18:24:29 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.info" returned: 0 in 1.123s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:29 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.info is being set with open permissions: ugo+rw: NotImplementedError Jul 05 18:24:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:29 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.info Jul 05 18:24:29 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Acquiring lock "cinder-quobyte-055b8376-ef85-4e13-bc24-3d0342c1b773" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:24:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Lock "cinder-quobyte-055b8376-ef85-4e13-bc24-3d0342c1b773" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:24:29 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc79be5-1209-4b65-81fd-9263d988d802]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:29 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 Jul 05 18:24:29 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:30 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.info" returned: 0 in 1.164s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.096s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ac988e81-5f2e-4912-bf22-cccc032e6055 tempest-GroupSnapshotsV319Test-887516817 None] group_snapshot 03ecf3b7-fdc9-4afc-a432-0570571f1f8d: created successfully Jul 05 18:24:30 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773" returned: 0 in 1.253s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:30 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773 Jul 05 18:24:30 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:31 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-055b8376-ef85-4e13-bc24-3d0342c1b773" returned: 0 in 0.956s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Lock "cinder-quobyte-055b8376-ef85-4e13-bc24-3d0342c1b773" released by "delete_volume" :: held 2.343s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:24:31 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Created reservations ['2db9f8a7-dbbf-458a-9ffd-c9776412252e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:24:31 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Created reservations ['a24d2e60-9ba1-43e1-9a81-d15bb9c6c2d7', 'b49a5ca8-9c83-4e6a-a360-797c62f5c7b4', 'ad507dba-6aae-4f38-a722-147dbbb0bb7b', '36bf1fe8-5dda-42d3-afea-7dd3631efd64'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:32 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:24:32 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] group_snapshot 03ecf3b7-fdc9-4afc-a432-0570571f1f8d: deleting Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] group_snapshot 03ecf3b7-fdc9-4afc-a432-0570571f1f8d: deleting {{(pid=86664) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Acquiring lock "cinder-quobyte-3833c834-76ea-43a6-9916-74bde2948361" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Lock "cinder-quobyte-3833c834-76ea-43a6-9916-74bde2948361" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Acquiring lock "cinder-quobyte-7353e983-bb9b-4795-9a23-03f23c2d034c" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Lock "cinder-quobyte-7353e983-bb9b-4795-9a23-03f23c2d034c" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Deleting offline snapshot 7353e983-bb9b-4795-9a23-03f23c2d034c of volume 3833c834-76ea-43a6-9916-74bde2948361 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] snapshot_file for this snap is: volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9f5227-b147-4a3a-b521-19d50ec93309]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:32 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c Jul 05 18:24:32 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:32 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.934s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:32 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:24:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-193fea61-b380-4d36-b988-523cf227f838 tempest-GroupsV314Test-682306130 None] Delete group completed successfully. Jul 05 18:24:33 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c" returned: 0 in 1.020s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3833c834-76ea-43a6-9916-74bde2948361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:24:33 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73ee575-26e6-4aa2-8476-4e179c132eda]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:33 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 Jul 05 18:24:33 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:34 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361" returned: 0 in 1.238s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:35 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c Jul 05 18:24:35 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:35 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c" returned: 0 in 0.984s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:36 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c Jul 05 18:24:36 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:36 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361.7353e983-bb9b-4795-9a23-03f23c2d034c" returned: 0 in 0.939s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Lock "cinder-quobyte-7353e983-bb9b-4795-9a23-03f23c2d034c" released by "_delete_snapshot" :: held 4.365s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:24:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Lock "cinder-quobyte-3833c834-76ea-43a6-9916-74bde2948361" released by "delete_snapshot" :: held 4.430s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:24:37 devstack cinder-volume[86664]: WARNING cinder.quota [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1459250136 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1459250136, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:24:37 devstack cinder-volume[86664]: WARNING cinder.quota [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1459250136 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1459250136, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:24:37 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] Created reservations ['31867133-4b4d-4c1f-b7e9-547fd8405959', '320d2698-5e82-455b-97e6-6a9debaa8df4', 'fffcddc2-cd49-4ff3-9aa1-0f042d538681', '3ce773be-576c-406c-9d78-0ea585a1c5de'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:24:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0050e057-561a-4217-9f35-24c0a6a8259f tempest-GroupSnapshotsV319Test-887516817 None] group_snapshot 03ecf3b7-fdc9-4afc-a432-0570571f1f8d: deleted successfully Jul 05 18:24:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Acquiring lock "cinder-quobyte-3833c834-76ea-43a6-9916-74bde2948361" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:24:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Lock "cinder-quobyte-3833c834-76ea-43a6-9916-74bde2948361" acquired by "delete_volume" :: waited 0.037s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:24:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[270c715d-2255-4a3d-b072-ce47ed074737]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:38 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 Jul 05 18:24:38 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:40 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361" returned: 0 in 1.399s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:40 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361 Jul 05 18:24:40 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:41 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3833c834-76ea-43a6-9916-74bde2948361" returned: 0 in 0.925s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Lock "cinder-quobyte-3833c834-76ea-43a6-9916-74bde2948361" released by "delete_volume" :: held 2.445s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Created reservations ['d30457a9-3186-463c-9f1f-463235c8c053'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:24:41 devstack cinder-volume[86664]: WARNING cinder.quota [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1459250136 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1459250136, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Created reservations ['b9916c52-9a88-4bb3-bdac-d599551b2fd0', '2fa1b080-b6d7-4054-9fbf-8d57706429dc', '3aa76a28-0222-4b1e-9571-b7f1bdd342f7', '516ca796-ca97-477a-8d51-32a11f97649c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:41 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:24:41 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:42 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.819s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:42 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:24:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e578db03-5ed6-4617-ae79-e4c3a86faff0 tempest-GroupSnapshotsV319Test-887516817 None] Delete group completed successfully. Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=40,cinder:SELECT=33,cinder:INSERT=9 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=37,cinder:UPDATE=40,cinder:INSERT=11 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Flow 'volume_create_manager' (755e8b3c-a6f3-4666-b767-88aca09957f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cda05d-f6d9-4795-893b-aa50cbba9ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cda05d-f6d9-4795-893b-aa50cbba9ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-922952744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f57acfe-603d-4f4c-95f5-a43d66be5e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75014a8509d4004b1d30b07c029400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:24:52Z,use_quota=True,user_id='be407ae3dabb47f185c8f01eb1cb0a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46af33fa-08d4-463c-9e76-c60dffc9302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46af33fa-08d4-463c-9e76-c60dffc9302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf26f6cc-aad3-40f8-a29b-6340915eb9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf26f6cc-aad3-40f8-a29b-6340915eb9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f57acfe-603d-4f4c-95f5-a43d66be5e51', 'volume_name': 'volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6622d8d-9848-4796-9180-fa53772ec132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6622d8d-9848-4796-9180-fa53772ec132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b922aca9-7f32-420f-9a22-4ec303d1d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:51 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Volume 2f57acfe-603d-4f4c-95f5-a43d66be5e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51', 'volume_size': 1} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-922952744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f57acfe-603d-4f4c-95f5-a43d66be5e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b75014a8509d4004b1d30b07c029400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:24:52Z,use_quota=True,user_id='be407ae3dabb47f185c8f01eb1cb0a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Creating volume 2f57acfe-603d-4f4c-95f5-a43d66be5e51 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:24:51 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:24:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:51 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 1073741824 Jul 05 18:24:51 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:53 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 1073741824" returned: 0 in 1.958s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:53 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 Jul 05 18:24:53 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:54 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51" returned: 0 in 1.068s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] <== create_volume: return (3125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:24:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.130s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b922aca9-7f32-420f-9a22-4ec303d1d579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9859477c-2f39-4d57-bb1c-b5da9c094df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:55 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Volume volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 (2f57acfe-603d-4f4c-95f5-a43d66be5e51): created successfully Jul 05 18:24:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9859477c-2f39-4d57-bb1c-b5da9c094df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Flow 'volume_create_manager' (755e8b3c-a6f3-4666-b767-88aca09957f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:24:55 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e8751782-7f2b-4d5f-894d-9dfd2c201b12 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Created volume successfully. Jul 05 18:24:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Acquiring lock "cinder-2f57acfe-603d-4f4c-95f5-a43d66be5e51-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:24:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "cinder-2f57acfe-603d-4f4c-95f5-a43d66be5e51-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:24:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Acquiring lock "cinder-quobyte-2f57acfe-603d-4f4c-95f5-a43d66be5e51" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:24:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "cinder-quobyte-2f57acfe-603d-4f4c-95f5-a43d66be5e51" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:24:58 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c51010-6c0a-443f-8f3a-4d2a3fb13f3d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:24:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:58 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 Jul 05 18:24:58 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Flow 'volume_create_manager' (f74f5ce3-800f-49cc-ba0a-f33b15a0c4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76014923-7685-456b-b3fa-b5588579b7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76014923-7685-456b-b3fa-b5588579b7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1857874938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1cab1a-644e-4041-8538-c5aeb6efeeb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f036b372f80a4be2949c45d76e723faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:24:59Z,use_quota=True,user_id='acbf1b1bc1e9444fb140caf46b57cd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1d3763-16d5-4a69-8b23-3a16e81848f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1d3763-16d5-4a69-8b23-3a16e81848f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8638500-d24c-4de8-8a0d-351ff9ef8f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8638500-d24c-4de8-8a0d-351ff9ef8f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff1cab1a-644e-4041-8538-c5aeb6efeeb9', 'volume_name': 'volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcb9eb8-7461-45ec-88ac-b97dcb3a6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bcb9eb8-7461-45ec-88ac-b97dcb3a6f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce339620-044a-4973-8f9f-c40cd1e27bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:24:59 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Volume ff1cab1a-644e-4041-8538-c5aeb6efeeb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9', 'volume_size': 1} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1857874938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1cab1a-644e-4041-8538-c5aeb6efeeb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f036b372f80a4be2949c45d76e723faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:24:59Z,use_quota=True,user_id='acbf1b1bc1e9444fb140caf46b57cd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Creating volume ff1cab1a-644e-4041-8538-c5aeb6efeeb9 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:24:59 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:59 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 1073741824 Jul 05 18:24:59 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:24:59 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51" returned: 0 in 1.277s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:24:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:24:59 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51 Jul 05 18:24:59 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:00 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 1073741824" returned: 0 in 1.418s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:00 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 Jul 05 18:25:00 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:01 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f57acfe-603d-4f4c-95f5-a43d66be5e51" returned: 0 in 1.207s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "cinder-quobyte-2f57acfe-603d-4f4c-95f5-a43d66be5e51" released by "delete_volume" :: held 2.569s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:01 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Created reservations ['4c26edf5-c088-4fae-8897-3a887f385e24', 'e3529a82-2cf6-4409-8ac0-7b5531a47293', 'ebf48f74-dfc1-4011-b57b-a0eeb80dffd8', '6fd8947a-19ec-43a8-8a63-9076b937a0bc'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:25:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:01 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:25:01 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:02 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9" returned: 0 in 1.388s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] <== create_volume: return (2889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.895s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce339620-044a-4973-8f9f-c40cd1e27bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fc28ca-bd44-492d-b198-17b7310dfb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:02 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.208s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:25:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Deleted volume successfully. Jul 05 18:25:02 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Volume volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 (ff1cab1a-644e-4041-8538-c5aeb6efeeb9): created successfully Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fc28ca-bd44-492d-b198-17b7310dfb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Flow 'volume_create_manager' (f74f5ce3-800f-49cc-ba0a-f33b15a0c4da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2d644908-fd42-4577-af1a-3b83a0f7eb18 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Created volume successfully. Jul 05 18:25:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3f103c35-7046-4ef3-a57f-9ef954949e20 tempest-VolumeQuotasNegativeTestJSON-1856578316 None] Lock "cinder-2f57acfe-603d-4f4c-95f5-a43d66be5e51-delete_volume" released by "delete_volume" :: held 4.225s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Acquiring lock "cinder-ff1cab1a-644e-4041-8538-c5aeb6efeeb9-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "cinder-ff1cab1a-644e-4041-8538-c5aeb6efeeb9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Acquiring lock "cinder-quobyte-ff1cab1a-644e-4041-8538-c5aeb6efeeb9" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "cinder-quobyte-ff1cab1a-644e-4041-8538-c5aeb6efeeb9" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:04 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0543adff-0470-47ee-931b-709849f961e8]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:04 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 Jul 05 18:25:04 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9" returned: 0 in 1.587s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:05 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:05 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9 Jul 05 18:25:05 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:06 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff1cab1a-644e-4041-8538-c5aeb6efeeb9" returned: 0 in 0.833s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "cinder-quobyte-ff1cab1a-644e-4041-8538-c5aeb6efeeb9" released by "delete_volume" :: held 2.492s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:06 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Created reservations ['76e5bef8-7c49-4bfd-8777-3961c1be8fd0', '752a2715-052b-444e-8d9a-0a40e7ad1df1', '0c680dee-8273-46d8-896b-b7722c3606aa', 'a6defb2d-19b2-46c3-9c4c-e7e8eddc24fb'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:25:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:07 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:25:07 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:08 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.185s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:25:08 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Deleted volume successfully. Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f90644b2-ea36-43dd-bdd4-de5d537367ed tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "cinder-ff1cab1a-644e-4041-8538-c5aeb6efeeb9-delete_volume" released by "delete_volume" :: held 4.077s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Flow 'volume_create_manager' (569cd127-0516-45fe-b98d-d7d940df3e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf803b5-eccc-4acb-9285-91497357b995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf803b5-eccc-4acb-9285-91497357b995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1340634621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed49ff8-29c8-4961-8326-692ad576b54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f036b372f80a4be2949c45d76e723faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:08Z,use_quota=True,user_id='acbf1b1bc1e9444fb140caf46b57cd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b2d9e5-af39-4c02-b16c-1a6867ee4412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b2d9e5-af39-4c02-b16c-1a6867ee4412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450e8772-b7c8-48d6-bcfb-6e9a8dc2cfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450e8772-b7c8-48d6-bcfb-6e9a8dc2cfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed49ff8-29c8-4961-8326-692ad576b54a', 'volume_name': 'volume-eed49ff8-29c8-4961-8326-692ad576b54a', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77f2ef5-3aa3-475c-9cfb-fc08e58dd192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77f2ef5-3aa3-475c-9cfb-fc08e58dd192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab58d567-c517-463c-821f-d9dfa44c0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:08 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Volume eed49ff8-29c8-4961-8326-692ad576b54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed49ff8-29c8-4961-8326-692ad576b54a', 'volume_size': 1} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1340634621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed49ff8-29c8-4961-8326-692ad576b54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f036b372f80a4be2949c45d76e723faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:08Z,use_quota=True,user_id='acbf1b1bc1e9444fb140caf46b57cd83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Creating volume eed49ff8-29c8-4961-8326-692ad576b54a {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:25:08 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:25:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:08 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a 1073741824 Jul 05 18:25:08 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:09 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a 1073741824" returned: 0 in 1.078s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:09 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a Jul 05 18:25:09 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:10 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a" returned: 0 in 1.099s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab58d567-c517-463c-821f-d9dfa44c0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed49ff8-29c8-4961-8326-692ad576b54a', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ac8ae3-555b-40c3-9a9e-4b5e87b05f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:10 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Volume volume-eed49ff8-29c8-4961-8326-692ad576b54a (eed49ff8-29c8-4961-8326-692ad576b54a): created successfully Jul 05 18:25:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ac8ae3-555b-40c3-9a9e-4b5e87b05f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Flow 'volume_create_manager' (569cd127-0516-45fe-b98d-d7d940df3e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:10 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6116d623-109b-4266-a453-5405569c88e7 tempest-VolumeQuotasAdminTestJSON-2100033186 None] Created volume successfully. Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:12 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:25:12 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Flow 'volume_create_manager' (9fe4fd5f-e570-4210-bbcb-8b39a3f5477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bc8e78-1ba0-4033-88ca-fd4b5e7b5322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71bc8e78-1ba0-4033-88ca-fd4b5e7b5322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1057077592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f3afb7-23a1-46be-8ca6-9c36fab4b72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68c27c55cb94c84900608128c93eb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:12Z,use_quota=True,user_id='834743f7508a41dcb17f903abc5d6cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b9c4ec-dbf1-462c-965d-4940abecb856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b9c4ec-dbf1-462c-965d-4940abecb856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3759879-c663-42b8-9b29-481a1b9a023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3759879-c663-42b8-9b29-481a1b9a023f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f3afb7-23a1-46be-8ca6-9c36fab4b72f', 'volume_name': 'volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447e7fe0-2296-486a-a78d-ffe3209b581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447e7fe0-2296-486a-a78d-ffe3209b581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0724a832-a5f8-4376-93a0-7acb4f27f1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:12 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Volume d2f3afb7-23a1-46be-8ca6-9c36fab4b72f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f', 'volume_size': 1} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1057077592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f3afb7-23a1-46be-8ca6-9c36fab4b72f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c68c27c55cb94c84900608128c93eb89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:12Z,use_quota=True,user_id='834743f7508a41dcb17f903abc5d6cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Creating volume d2f3afb7-23a1-46be-8ca6-9c36fab4b72f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:25:12 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:12 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f 1073741824 Jul 05 18:25:12 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:12 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e4bd14c1-6be1-48e6-9539-cf1abe21e614 tempest-VolumeQuotasAdminTestJSON-1570927773 None] Transfer volume completed successfully. Jul 05 18:25:12 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.917s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:25:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:25:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 8 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:25:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:25:13 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f 1073741824" returned: 0 in 1.278s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:13 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f Jul 05 18:25:13 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Acquiring lock "cinder-eed49ff8-29c8-4961-8326-692ad576b54a-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Lock "cinder-eed49ff8-29c8-4961-8326-692ad576b54a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Acquiring lock "cinder-quobyte-eed49ff8-29c8-4961-8326-692ad576b54a" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Lock "cinder-quobyte-eed49ff8-29c8-4961-8326-692ad576b54a" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6afa631-31d4-440e-a60f-51d474cbf4a6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:14 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a Jul 05 18:25:14 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:14 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" returned: 0 in 1.015s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0724a832-a5f8-4376-93a0-7acb4f27f1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43bbf75-7e11-43ac-b58c-a1ea2a05d270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:14 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Volume volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f (d2f3afb7-23a1-46be-8ca6-9c36fab4b72f): created successfully Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c43bbf75-7e11-43ac-b58c-a1ea2a05d270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Flow 'volume_create_manager' (9fe4fd5f-e570-4210-bbcb-8b39a3f5477b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:14 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-874b805e-ce78-480d-b705-9c09c775c798 tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Created volume successfully. Jul 05 18:25:15 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a" returned: 0 in 0.961s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:15 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a Jul 05 18:25:15 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Creating offline snapshot f73c75cf-6970-463b-988d-ddf41a5482be of volume d2f3afb7-23a1-46be-8ca6-9c36fab4b72f {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:25:15 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a064545d-4841-45b2-a0e9-b8c7b24aec1b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:16 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eed49ff8-29c8-4961-8326-692ad576b54a" returned: 0 in 1.003s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Lock "cinder-quobyte-eed49ff8-29c8-4961-8326-692ad576b54a" released by "delete_volume" :: held 2.029s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:16 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f Jul 05 18:25:16 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:16 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Created reservations ['d75a6470-1abd-48c8-8e2e-77d271636ff7', 'a5a590ab-ace2-4df2-8122-f8b4384a16a0', 'bd3ec32c-e479-41e8-8585-c112718a137c', '94e4913e-eb64-4275-9429-f15af4689d8b'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:25:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:16 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:25:16 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:17 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" returned: 0 in 1.044s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:17 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be 1G Jul 05 18:25:17 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:17 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.794s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:25:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Deleted volume successfully. Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dcacda3-e2a9-4e22-9ed5-8b448b0e71c3 tempest-VolumeQuotasAdminTestJSON-537081418 None] Lock "cinder-eed49ff8-29c8-4961-8326-692ad576b54a-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Flow 'volume_create_manager' (e02baedb-c5d8-40ea-8224-4626a15c8e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f588b5-55a1-433a-9d03-a041c96deed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f588b5-55a1-433a-9d03-a041c96deed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-299411611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e4ee95-3516-40cb-a2a0-ee98a8733822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25a9b155ec049cbaa5df3eb6452e48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:17Z,use_quota=True,user_id='80dfc9e847d1497a9bed01650fa8ad09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765e8c46-8eb2-4681-975b-ed406afef498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765e8c46-8eb2-4681-975b-ed406afef498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84388ba0-92b4-435b-8da3-203838802f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84388ba0-92b4-435b-8da3-203838802f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e4ee95-3516-40cb-a2a0-ee98a8733822', 'volume_name': 'volume-08e4ee95-3516-40cb-a2a0-ee98a8733822', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20a341b-2f87-49df-85d5-2f50a37fefd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f20a341b-2f87-49df-85d5-2f50a37fefd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8484555a-6d0c-4cb8-9f72-471435fb6151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:17 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Volume 08e4ee95-3516-40cb-a2a0-ee98a8733822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e4ee95-3516-40cb-a2a0-ee98a8733822', 'volume_size': 1} Jul 05 18:25:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:18 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be 1G" returned: 0 in 1.080s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:18 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be Jul 05 18:25:18 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:19 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be" returned: 0 in 1.221s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:19 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be is being set with open permissions: ugo+rw Jul 05 18:25:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:19 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be Jul 05 18:25:19 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:20 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be" returned: 0 in 0.855s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:20 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.info Jul 05 18:25:20 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:21 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.info" returned: 0 in 0.913s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:21 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.info is being set with open permissions: ugo+rw Jul 05 18:25:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:21 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.info Jul 05 18:25:21 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:22 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.info" returned: 0 in 0.927s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.217s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.621s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-299411611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e4ee95-3516-40cb-a2a0-ee98a8733822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25a9b155ec049cbaa5df3eb6452e48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:17Z,use_quota=True,user_id='80dfc9e847d1497a9bed01650fa8ad09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Creating volume 08e4ee95-3516-40cb-a2a0-ee98a8733822 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:25:22 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:25:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:22 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 1073741824 Jul 05 18:25:22 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b7cdc364-2c56-450f-8c75-737a8cdaffec tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Create snapshot completed successfully Jul 05 18:25:23 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 1073741824" returned: 0 in 1.180s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:23 devstack sudo[94649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 Jul 05 18:25:23 devstack sudo[94649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Acquiring lock "cinder-f73c75cf-6970-463b-988d-ddf41a5482be-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-f73c75cf-6970-463b-988d-ddf41a5482be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Acquiring lock "cinder-quobyte-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-quobyte-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Acquiring lock "cinder-quobyte-f73c75cf-6970-463b-988d-ddf41a5482be" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-quobyte-f73c75cf-6970-463b-988d-ddf41a5482be" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Deleting offline snapshot f73c75cf-6970-463b-988d-ddf41a5482be of volume d2f3afb7-23a1-46be-8ca6-9c36fab4b72f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] snapshot_file for this snap is: volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d1536-643d-4bf5-a3b5-64f91f79c250]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:24 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be Jul 05 18:25:24 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:24 devstack sudo[94649]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822" returned: 0 in 0.920s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8484555a-6d0c-4cb8-9f72-471435fb6151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e4ee95-3516-40cb-a2a0-ee98a8733822', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce2ee42-6208-4f65-9493-588ce4fd955d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:24 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Volume volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 (08e4ee95-3516-40cb-a2a0-ee98a8733822): created successfully Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce2ee42-6208-4f65-9493-588ce4fd955d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Flow 'volume_create_manager' (e02baedb-c5d8-40ea-8224-4626a15c8e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:24 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9161128f-c078-47d3-8a94-110a16869706 tempest-AttachVolumeNegativeTest-503091028 None] Created volume successfully. Jul 05 18:25:25 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be" returned: 0 in 1.373s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:25:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a698159-259e-4d6f-a287-962ddb45437d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:25 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f Jul 05 18:25:25 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:26 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" returned: 0 in 1.014s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:26 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be Jul 05 18:25:26 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:27 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be" returned: 0 in 1.149s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:27 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be Jul 05 18:25:27 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:28 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f.f73c75cf-6970-463b-988d-ddf41a5482be" returned: 0 in 1.169s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-quobyte-f73c75cf-6970-463b-988d-ddf41a5482be" released by "_delete_snapshot" :: held 4.928s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-quobyte-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" released by "delete_snapshot" :: held 4.957s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Created reservations ['7014af95-a4be-4613-a4cf-ff019905612f', '0beca053-b265-4268-bc88-a11d0d0d1a89', '3a9f32be-11c2-47c9-823c-77b3204cbb1f', 'dd409aba-0594-43de-9cd5-cdd73a1affcf'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c5ce593e-bd4e-4ce9-8740-28b7307c1132 req-e4619d4e-1c4a-48fc-b321-1f86faf69631 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c5ce593e-bd4e-4ce9-8740-28b7307c1132 req-e4619d4e-1c4a-48fc-b321-1f86faf69631 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb34c88-39c1-440c-ae78-7a4592a1abe8]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c5ce593e-bd4e-4ce9-8740-28b7307c1132 req-e4619d4e-1c4a-48fc-b321-1f86faf69631 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Delete snapshot completed successfully. Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-83123af2-20f4-4a77-ae4e-df276a9520ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-f73c75cf-6970-463b-988d-ddf41a5482be-delete_snapshot" released by "delete_snapshot" :: held 5.463s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:29 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 Jul 05 18:25:29 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Acquiring lock "cinder-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Acquiring lock "cinder-quobyte-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-quobyte-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" acquired by "delete_volume" :: waited 0.046s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:30 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1679d18e-84ce-411e-926b-0a7be469e9ef]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:30 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f Jul 05 18:25:30 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:30 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c5ce593e-bd4e-4ce9-8740-28b7307c1132 req-e4619d4e-1c4a-48fc-b321-1f86faf69631 tempest-AttachVolumeNegativeTest-503091028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822" returned: 0 in 1.208s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c5ce593e-bd4e-4ce9-8740-28b7307c1132 req-e4619d4e-1c4a-48fc-b321-1f86faf69631 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.270s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-c5ce593e-bd4e-4ce9-8740-28b7307c1132 req-e4619d4e-1c4a-48fc-b321-1f86faf69631 tempest-AttachVolumeNegativeTest-503091028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-08e4ee95-3516-40cb-a2a0-ee98a8733822', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28d8f8a2-758b-4d4b-b906-c1ffe336d722', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:25:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-c5ce593e-bd4e-4ce9-8740-28b7307c1132 req-e4619d4e-1c4a-48fc-b321-1f86faf69631 tempest-AttachVolumeNegativeTest-503091028 None] attachment_update completed successfully. Jul 05 18:25:31 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" returned: 0 in 1.812s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:31 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f Jul 05 18:25:31 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (c696344d-e3b3-4399-983a-b493ee5c76d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2345fe-13d3-40b0-a87f-c4353a54e1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2345fe-13d3-40b0-a87f-c4353a54e1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1242505662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5af5dfa-b41a-4317-9d1e-b10d842f6e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:32Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9059c4d8-1020-4d78-aa55-ee5c91547462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9059c4d8-1020-4d78-aa55-ee5c91547462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81a899c-3817-4405-8045-44c3d5289d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e81a899c-3817-4405-8045-44c3d5289d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5af5dfa-b41a-4317-9d1e-b10d842f6e86', 'volume_name': 'volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0403c63f-79af-4e01-ada0-2998006085d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0403c63f-79af-4e01-ada0-2998006085d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fb154e-07b4-4597-9dd4-caea9775b387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:32 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Volume a5af5dfa-b41a-4317-9d1e-b10d842f6e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86', 'volume_size': 1} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1242505662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5af5dfa-b41a-4317-9d1e-b10d842f6e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:32Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Creating volume a5af5dfa-b41a-4317-9d1e-b10d842f6e86 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:25:32 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:25:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:32 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 1073741824 Jul 05 18:25:32 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:33 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" returned: 0 in 1.213s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-quobyte-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f" released by "delete_volume" :: held 3.126s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:33 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Created reservations ['37c843e2-1927-46b7-9b17-41d5de0750e5', '6edecde8-c42a-4c24-9a13-ca61660d026a', '4b710c48-4a07-416a-ae8d-990f9983fcae', '14d10402-be7f-46fa-ac22-36089ba1b804'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:25:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:33 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:25:33 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:34 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.320s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:34 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:25:34 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Deleted volume successfully. Jul 05 18:25:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c35f1d2d-1180-4cbf-9a11-1137f546e63c tempest-VolumeSnapshotQuotasNegativeTestJSON-1242523153 None] Lock "cinder-d2f3afb7-23a1-46be-8ca6-9c36fab4b72f-delete_volume" released by "delete_volume" :: held 4.940s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:34 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 1073741824" returned: 0 in 2.043s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:35 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 Jul 05 18:25:35 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Flow 'volume_create_manager' (58eb5827-0089-47cc-a9d8-59984437b018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f386a9c0-2540-4908-9b5e-90b331ee5cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f386a9c0-2540-4908-9b5e-90b331ee5cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-356555406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2b322c0e834b1989eabe9ae1c992e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:35Z,use_quota=True,user_id='743ec26b7503446cb9782753e221e54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb4f668-79e5-4223-a6fa-340622a2902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb4f668-79e5-4223-a6fa-340622a2902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2558f5f-7cac-4be3-a167-59582217f84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2558f5f-7cac-4be3-a167-59582217f84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b', 'volume_name': 'volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08402dc3-774c-43d8-a687-553ea9d0d918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08402dc3-774c-43d8-a687-553ea9d0d918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4bc8a8-4621-440a-a974-e3d761e7e0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Volume 28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b', 'volume_size': 1} Jul 05 18:25:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:36 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86" returned: 0 in 1.208s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] <== create_volume: return (3381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.385s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-356555406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2b322c0e834b1989eabe9ae1c992e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:35Z,use_quota=True,user_id='743ec26b7503446cb9782753e221e54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Creating volume 28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:25:36 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:36 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b 1073741824 Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fb154e-07b4-4597-9dd4-caea9775b387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:36 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383ddbb4-eb0d-4fb9-adf4-bf10432e777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:36 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Volume volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 (a5af5dfa-b41a-4317-9d1e-b10d842f6e86): created successfully Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383ddbb4-eb0d-4fb9-adf4-bf10432e777d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (c696344d-e3b3-4399-983a-b493ee5c76d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:36 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3f8554b0-1fb5-41e3-a1fe-a8910355b512 tempest-VolumesActionsTest-628721459 None] Created volume successfully. Jul 05 18:25:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4e136b42-62c6-4ae7-b5dd-da94131eb24b tempest-VolumesActionsTest-628721459 None] Acquiring lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86" by "attach_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4e136b42-62c6-4ae7-b5dd-da94131eb24b tempest-VolumesActionsTest-628721459 None] Lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86" acquired by "attach_volume" :: waited 0.102s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4e136b42-62c6-4ae7-b5dd-da94131eb24b tempest-VolumesActionsTest-628721459 None] Attaching volume a5af5dfa-b41a-4317-9d1e-b10d842f6e86 to instance 7fb6f46a-6df1-4b2a-b34f-a6627de1e23e at mountpoint /dev/vdb on host None. Jul 05 18:25:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4e136b42-62c6-4ae7-b5dd-da94131eb24b tempest-VolumesActionsTest-628721459 None] Attach volume completed successfully. Jul 05 18:25:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4e136b42-62c6-4ae7-b5dd-da94131eb24b tempest-VolumesActionsTest-628721459 None] Lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86" released by "attach_volume" :: held 0.305s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:37 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b 1073741824" returned: 0 in 1.548s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:37 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b Jul 05 18:25:37 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:38 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b" returned: 0 in 1.126s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] <== create_volume: return (2764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.767s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4bc8a8-4621-440a-a974-e3d761e7e0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96915c3-63c9-4277-bb4b-068202805d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:39 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Volume volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b (28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b): created successfully Jul 05 18:25:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c96915c3-63c9-4277-bb4b-068202805d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Flow 'volume_create_manager' (58eb5827-0089-47cc-a9d8-59984437b018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c125c9e3-1bf0-4bc1-a327-8462249eebf9 tempest-VolumesTransfersTest-1149058828 None] Created volume successfully. Jul 05 18:25:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6503268a-0493-43be-a569-e46029354e21 tempest-VolumesActionsTest-1795192648 None] Terminate volume connection completed successfully. Jul 05 18:25:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-1cc2834c-6329-4d84-a552-0a055508da18 req-24d87803-c92f-4b4f-8191-8124b6f32d54 tempest-AttachVolumeNegativeTest-503091028 None] Terminate volume connection completed successfully. Jul 05 18:25:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-1cc2834c-6329-4d84-a552-0a055508da18 req-24d87803-c92f-4b4f-8191-8124b6f32d54 tempest-AttachVolumeNegativeTest-503091028 None] Deleting attachment 28d8f8a2-758b-4d4b-b906-c1ffe336d722. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:25:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6503268a-0493-43be-a569-e46029354e21 tempest-VolumesActionsTest-1795192648 None] Acquiring lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86-detach_volume" by "detach_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6503268a-0493-43be-a569-e46029354e21 tempest-VolumesActionsTest-1795192648 None] Lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6503268a-0493-43be-a569-e46029354e21 tempest-VolumesActionsTest-1795192648 None] Detaching volume a5af5dfa-b41a-4317-9d1e-b10d842f6e86 from instance 7fb6f46a-6df1-4b2a-b34f-a6627de1e23e. Jul 05 18:25:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6503268a-0493-43be-a569-e46029354e21 tempest-VolumesActionsTest-1795192648 None] Detach volume completed successfully. Jul 05 18:25:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6503268a-0493-43be-a569-e46029354e21 tempest-VolumesActionsTest-1795192648 None] Lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0123f3ac-9154-450c-a247-3c224993290c tempest-VolumesActionsTest-628721459 None] Acquiring lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86-detach_volume" by "detach_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0123f3ac-9154-450c-a247-3c224993290c tempest-VolumesActionsTest-628721459 None] Lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:40 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0123f3ac-9154-450c-a247-3c224993290c tempest-VolumesActionsTest-628721459 None] Volume detach called, but volume not attached. Jul 05 18:25:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0123f3ac-9154-450c-a247-3c224993290c tempest-VolumesActionsTest-628721459 None] Lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Acquiring lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Acquiring lock "cinder-quobyte-a5af5dfa-b41a-4317-9d1e-b10d842f6e86" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Lock "cinder-quobyte-a5af5dfa-b41a-4317-9d1e-b10d842f6e86" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf0e44f-e17b-42b3-a2b8-3b4f3f259d87]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:41 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 Jul 05 18:25:41 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c9f94071-6655-4bc0-98f4-e09ef16cf988 tempest-VolumesTransfersTest-1945510024 None] Transfer volume completed successfully. Jul 05 18:25:43 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86" returned: 0 in 1.564s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:43 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86 Jul 05 18:25:43 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Acquiring lock "cinder-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Lock "cinder-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Acquiring lock "cinder-quobyte-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Lock "cinder-quobyte-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b" acquired by "delete_volume" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b57645-3d37-4278-b073-d43eabde6a72]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:43 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b Jul 05 18:25:43 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:43 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5af5dfa-b41a-4317-9d1e-b10d842f6e86" returned: 0 in 0.843s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Lock "cinder-quobyte-a5af5dfa-b41a-4317-9d1e-b10d842f6e86" released by "delete_volume" :: held 2.474s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:44 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Created reservations ['46237d16-39ba-4764-919b-4c0d3660d476', '5ad69ca8-9ea8-4869-a294-98aa61cbe63e', 'f39fd137-40e9-4ae9-844c-d92bb1e443f2', '6f87b1ee-a33f-4e11-a039-e89775a3d44c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:25:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:44 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:25:44 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:45 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b" returned: 0 in 1.475s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:45 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b Jul 05 18:25:45 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:45 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.156s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:45 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:25:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Deleted volume successfully. Jul 05 18:25:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aeec3caf-8b1f-4f44-9d97-e01e05015a01 tempest-VolumesActionsTest-628721459 None] Lock "cinder-a5af5dfa-b41a-4317-9d1e-b10d842f6e86-delete_volume" released by "delete_volume" :: held 3.972s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:46 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b" returned: 0 in 0.994s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Lock "cinder-quobyte-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b" released by "delete_volume" :: held 2.536s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:46 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Created reservations ['a5d043ba-78d1-498b-9d3b-2c20fc56dbb1', 'dc641fec-9072-4b19-bfa5-9e7eb86dbf3f', 'b31c2f7b-48ad-49e1-927e-30db6698fd54', '2364a121-ca3d-4414-81d1-51e82238bead'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:25:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:46 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:25:46 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.243s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:47 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:25:47 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Deleted volume successfully. Jul 05 18:25:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-84ecd3ef-d076-455b-ba7f-57e3ddbdd6c2 tempest-VolumesTransfersTest-120021162 None] Lock "cinder-28e4ab03-4dd6-4eca-8d8d-08a0b5b26a8b-delete_volume" released by "delete_volume" :: held 4.233s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Flow 'volume_create_manager' (cff088d6-d157-43da-af11-d8b242728342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc0991a-f934-4b1f-ba08-a533ab302534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc0991a-f934-4b1f-ba08-a533ab302534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-436466501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d739620-1c26-4829-b55e-3daae344437d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2b322c0e834b1989eabe9ae1c992e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:48Z,use_quota=True,user_id='743ec26b7503446cb9782753e221e54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9a9cf-cf81-41bd-a4c8-b127fe0744a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9a9cf-cf81-41bd-a4c8-b127fe0744a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0149218d-9515-43aa-ac31-1932c50490a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0149218d-9515-43aa-ac31-1932c50490a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d739620-1c26-4829-b55e-3daae344437d', 'volume_name': 'volume-3d739620-1c26-4829-b55e-3daae344437d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b3a172-3e87-4074-b549-3234cb34cb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b3a172-3e87-4074-b549-3234cb34cb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f20778-4eaa-4c8e-8fe7-694751da700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:48 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Volume 3d739620-1c26-4829-b55e-3daae344437d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d739620-1c26-4829-b55e-3daae344437d', 'volume_size': 1} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-436466501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d739620-1c26-4829-b55e-3daae344437d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2b322c0e834b1989eabe9ae1c992e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:48Z,use_quota=True,user_id='743ec26b7503446cb9782753e221e54d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Creating volume 3d739620-1c26-4829-b55e-3daae344437d {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:25:48 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:25:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:48 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d 1073741824 Jul 05 18:25:48 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:49 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d 1073741824" returned: 0 in 1.205s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:49 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d Jul 05 18:25:49 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:50 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d" returned: 0 in 0.794s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:50 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f20778-4eaa-4c8e-8fe7-694751da700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d739620-1c26-4829-b55e-3daae344437d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc26ef1-599c-43cf-afa2-b87687fdc0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:50 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Volume volume-3d739620-1c26-4829-b55e-3daae344437d (3d739620-1c26-4829-b55e-3daae344437d): created successfully Jul 05 18:25:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc26ef1-599c-43cf-afa2-b87687fdc0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Flow 'volume_create_manager' (cff088d6-d157-43da-af11-d8b242728342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:50 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b0e2da82-bbc1-42a4-9d40-885338bdce61 tempest-VolumesTransfersTest-1149058828 None] Created volume successfully. Jul 05 18:25:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Acquiring lock "cinder-3d739620-1c26-4829-b55e-3daae344437d-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Lock "cinder-3d739620-1c26-4829-b55e-3daae344437d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:51 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=88,cinder:INSERT=23,cinder:DELETE=9,cinder:SELECT=69 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:25:51 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=73,cinder:UPDATE=82,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:25:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Acquiring lock "cinder-quobyte-3d739620-1c26-4829-b55e-3daae344437d" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Lock "cinder-quobyte-3d739620-1c26-4829-b55e-3daae344437d" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:51 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f7e527-6e55-4eab-94ff-2c5088c9d2b4]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:52 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d Jul 05 18:25:52 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Flow 'volume_create_manager' (4daf63f4-f69c-4b94-a462-0a510d80aeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cca8afa-243a-4411-8fce-d7e1d977fa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cca8afa-243a-4411-8fce-d7e1d977fa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2018437768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b672ba08-cb12-4ba1-b073-e7578b6f05c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c6a366c97e4ff39e67d9c7047d82c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:52Z,use_quota=True,user_id='345b3e2f9cea4293b90ee5cd3056bd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a243f1fc-50a9-493c-9aad-b3d053132b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a243f1fc-50a9-493c-9aad-b3d053132b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be09645-031c-4c79-8a0a-14b26d6aeeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be09645-031c-4c79-8a0a-14b26d6aeeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b672ba08-cb12-4ba1-b073-e7578b6f05c9', 'volume_name': 'volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb57478-8690-4740-8004-5ff35896f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb57478-8690-4740-8004-5ff35896f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729f283a-eac7-4499-958b-bb1a99c2f112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:52 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Volume b672ba08-cb12-4ba1-b073-e7578b6f05c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9', 'volume_size': 1} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2018437768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b672ba08-cb12-4ba1-b073-e7578b6f05c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c6a366c97e4ff39e67d9c7047d82c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:52Z,use_quota=True,user_id='345b3e2f9cea4293b90ee5cd3056bd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Creating volume b672ba08-cb12-4ba1-b073-e7578b6f05c9 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:25:52 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:25:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:52 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 1073741824 Jul 05 18:25:52 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:53 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d" returned: 0 in 1.203s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:53 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d Jul 05 18:25:53 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (74ada1ce-5d9a-48de-9fb7-35d02dc881da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408bd84d-ced4-4faa-9fd6-d74b6cf031c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408bd84d-ced4-4faa-9fd6-d74b6cf031c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-167078768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c37a3ea-e983-4e81-a911-2b918a81027e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:53Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb609556-c1a3-4cfc-aa66-6991bde2c99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb609556-c1a3-4cfc-aa66-6991bde2c99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d7145f-4515-4c1c-a641-93092e36518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d7145f-4515-4c1c-a641-93092e36518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c37a3ea-e983-4e81-a911-2b918a81027e', 'volume_name': 'volume-2c37a3ea-e983-4e81-a911-2b918a81027e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6c4fdd-d76a-4f50-b97d-e10c73969094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6c4fdd-d76a-4f50-b97d-e10c73969094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39a82bb-0f8f-4f3b-bd04-270501076939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:53 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Volume 2c37a3ea-e983-4e81-a911-2b918a81027e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c37a3ea-e983-4e81-a911-2b918a81027e', 'volume_size': 1} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:53 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 1073741824" returned: 0 in 1.217s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:53 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 Jul 05 18:25:53 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:54 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3d739620-1c26-4829-b55e-3daae344437d" returned: 0 in 0.916s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Lock "cinder-quobyte-3d739620-1c26-4829-b55e-3daae344437d" released by "delete_volume" :: held 2.183s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Created reservations ['3ba53bf9-f0df-4fa0-897f-daf865141415', '0607d7cb-40f8-44ab-89e3-ec939161b06f', '1933ab41-b19f-4d08-98ac-b99e9280805b', '20c82ec7-34ac-4fb9-8d51-b34bb6fc1e08'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:54 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:25:54 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:54 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9" returned: 0 in 0.738s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-167078768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c37a3ea-e983-4e81-a911-2b918a81027e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:53Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Creating volume 2c37a3ea-e983-4e81-a911-2b918a81027e {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:25:54 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:54 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e 1073741824 Jul 05 18:25:54 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729f283a-eac7-4499-958b-bb1a99c2f112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1891dfd4-af24-4512-8439-f61918c15182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:54 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Volume volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 (b672ba08-cb12-4ba1-b073-e7578b6f05c9): created successfully Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1891dfd4-af24-4512-8439-f61918c15182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Flow 'volume_create_manager' (4daf63f4-f69c-4b94-a462-0a510d80aeaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a1140e8b-82ee-4274-8449-de7c14197cfd tempest-VolumesListAdminTestJSON-201290706 None] Created volume successfully. Jul 05 18:25:55 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.773s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:55 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:25:55 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Deleted volume successfully. Jul 05 18:25:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0d008dbc-5f9a-43c2-8054-853707a83804 tempest-VolumesTransfersTest-120021162 None] Lock "cinder-3d739620-1c26-4829-b55e-3daae344437d-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:25:55 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e 1073741824" returned: 0 in 1.097s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:55 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e Jul 05 18:25:55 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Flow 'volume_create_manager' (b4474f2d-3615-4c3c-9a33-89c65eb30bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa470d6f-e1e7-4e10-99e2-fd2d0c4c296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa470d6f-e1e7-4e10-99e2-fd2d0c4c296e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1264688157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2e2340-6b88-4524-93d1-fd15510766b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c6a366c97e4ff39e67d9c7047d82c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:57Z,use_quota=True,user_id='345b3e2f9cea4293b90ee5cd3056bd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca23452e-e217-4859-a04e-ea78abcc7395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca23452e-e217-4859-a04e-ea78abcc7395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf5f54e-e1a7-4fdd-94bf-15b1ee800404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf5f54e-e1a7-4fdd-94bf-15b1ee800404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e2e2340-6b88-4524-93d1-fd15510766b4', 'volume_name': 'volume-3e2e2340-6b88-4524-93d1-fd15510766b4', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76df5315-8975-448a-9e95-25fa29144b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76df5315-8975-448a-9e95-25fa29144b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d686bec-b270-4c41-8f46-a817094e79d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Volume 3e2e2340-6b88-4524-93d1-fd15510766b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e2e2340-6b88-4524-93d1-fd15510766b4', 'volume_size': 1} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:56 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e" returned: 0 in 1.078s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1264688157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2e2340-6b88-4524-93d1-fd15510766b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c6a366c97e4ff39e67d9c7047d82c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:25:57Z,use_quota=True,user_id='345b3e2f9cea4293b90ee5cd3056bd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Creating volume 3e2e2340-6b88-4524-93d1-fd15510766b4 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:25:56 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:56 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4 1073741824 Jul 05 18:25:56 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39a82bb-0f8f-4f3b-bd04-270501076939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c37a3ea-e983-4e81-a911-2b918a81027e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc956b9-c841-4ac5-bca4-06647631b157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Volume volume-2c37a3ea-e983-4e81-a911-2b918a81027e (2c37a3ea-e983-4e81-a911-2b918a81027e): created successfully Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc956b9-c841-4ac5-bca4-06647631b157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (74ada1ce-5d9a-48de-9fb7-35d02dc881da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a53d4ece-6a7a-43d8-ab25-ec746a4957b2 tempest-VolumesActionsTest-628721459 None] Created volume successfully. Jul 05 18:25:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Acquiring lock "cinder-2c37a3ea-e983-4e81-a911-2b918a81027e-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Lock "cinder-2c37a3ea-e983-4e81-a911-2b918a81027e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Acquiring lock "cinder-quobyte-2c37a3ea-e983-4e81-a911-2b918a81027e" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:25:58 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4 1073741824" returned: 0 in 1.151s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Lock "cinder-quobyte-2c37a3ea-e983-4e81-a911-2b918a81027e" acquired by "delete_volume" :: waited 0.031s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:25:58 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[43381226-f570-44a2-b379-69345c6c523f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:25:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:58 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4 Jul 05 18:25:58 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:58 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e Jul 05 18:25:58 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:59 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4" returned: 0 in 0.976s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:25:59 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d686bec-b270-4c41-8f46-a817094e79d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2e2340-6b88-4524-93d1-fd15510766b4', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f7d5c-ff4e-4a01-bcdf-e26b5314130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e" returned: 0 in 1.054s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:25:59 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e Jul 05 18:25:59 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:25:59 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Volume volume-3e2e2340-6b88-4524-93d1-fd15510766b4 (3e2e2340-6b88-4524-93d1-fd15510766b4): created successfully Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9f7d5c-ff4e-4a01-bcdf-e26b5314130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Flow 'volume_create_manager' (b4474f2d-3615-4c3c-9a33-89c65eb30bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:25:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5dcd4e18-afee-48ec-a328-e17449e7a906 tempest-VolumesListAdminTestJSON-201290706 None] Created volume successfully. Jul 05 18:25:59 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2c37a3ea-e983-4e81-a911-2b918a81027e" returned: 0 in 0.780s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:25:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Lock "cinder-quobyte-2c37a3ea-e983-4e81-a911-2b918a81027e" released by "delete_volume" :: held 1.893s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Created reservations ['787cb3be-4436-4df8-ac27-f8604123c0ca', '3bad64e4-4602-4565-8e69-900a0de4db21', '6566290e-d129-4e61-9d9f-9419f3450e3a', '8398691a-d966-4fa3-b866-b8e4d3b21e8c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:00 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:00 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Flow 'volume_create_manager' (230aea9d-74c3-4f14-b8de-e1ae6f384732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ca47b3-bec4-43bd-882a-55500618232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ca47b3-bec4-43bd-882a-55500618232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1618751674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2ee8d8-3710-4778-bbe9-c298d07676e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c6a366c97e4ff39e67d9c7047d82c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:01Z,use_quota=True,user_id='345b3e2f9cea4293b90ee5cd3056bd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2c2d5b-b292-43ee-893c-f6d4c1cca971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2c2d5b-b292-43ee-893c-f6d4c1cca971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7888755c-a28c-400a-8875-171bc5ef1dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7888755c-a28c-400a-8875-171bc5ef1dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2ee8d8-3710-4778-bbe9-c298d07676e1', 'volume_name': 'volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e48fa7d-0a94-496e-ad23-01cd45d9d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e48fa7d-0a94-496e-ad23-01cd45d9d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07cf894-2eee-48bb-b673-38e4510ae622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:00 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Volume 1d2ee8d8-3710-4778-bbe9-c298d07676e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1', 'volume_size': 1} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1618751674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2ee8d8-3710-4778-bbe9-c298d07676e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c6a366c97e4ff39e67d9c7047d82c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:01Z,use_quota=True,user_id='345b3e2f9cea4293b90ee5cd3056bd89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Creating volume 1d2ee8d8-3710-4778-bbe9-c298d07676e1 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:26:01 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:01 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 1073741824 Jul 05 18:26:01 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (bca8f002-df24-4b26-9c26-6d7a94ee8b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8f8c69-01dc-412e-af5f-4dd88b3d625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:01 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.185s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Deleted volume successfully. Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8f8c69-01dc-412e-af5f-4dd88b3d625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-50285075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c46dd3-c3c6-4a46-9591-bb56e4b3a319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:01Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23527309-7825-4cfa-84c7-b81d109df10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23527309-7825-4cfa-84c7-b81d109df10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4a9ad6-c2bf-406b-9d98-13e30874776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4a9ad6-c2bf-406b-9d98-13e30874776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c46dd3-c3c6-4a46-9591-bb56e4b3a319', 'volume_name': 'volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7277ada4-7df8-4690-9eb7-825416d8fe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7277ada4-7df8-4690-9eb7-825416d8fe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4245621c-af0a-4518-8386-7b53a2f7570f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:01 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Volume 69c46dd3-c3c6-4a46-9591-bb56e4b3a319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319', 'volume_size': 1} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-086b78e8-a135-4e4e-841d-7b6a3b25fae0 tempest-VolumesActionsTest-1795192648 None] Lock "cinder-2c37a3ea-e983-4e81-a911-2b918a81027e-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:02 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 1073741824" returned: 0 in 1.349s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:02 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 Jul 05 18:26:02 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:03 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1" returned: 0 in 0.957s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] <== create_volume: return (2378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.388s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-50285075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c46dd3-c3c6-4a46-9591-bb56e4b3a319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:01Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Creating volume 69c46dd3-c3c6-4a46-9591-bb56e4b3a319 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:26:03 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07cf894-2eee-48bb-b673-38e4510ae622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:03 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 1073741824 Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13305b8-17af-41c7-91c1-fd523f0f167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:03 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:03 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Volume volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 (1d2ee8d8-3710-4778-bbe9-c298d07676e1): created successfully Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13305b8-17af-41c7-91c1-fd523f0f167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Flow 'volume_create_manager' (230aea9d-74c3-4f14-b8de-e1ae6f384732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:03 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d1c5cd25-1d3b-43a8-9397-b469562edadd tempest-VolumesListAdminTestJSON-201290706 None] Created volume successfully. Jul 05 18:26:04 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 1073741824" returned: 0 in 1.586s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:05 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 Jul 05 18:26:05 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Flow 'volume_create_manager' (f3aeb2d9-6fc4-40e4-ac99-9916219d2353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c6ea76-7180-4546-aa80-d565caef642f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c6ea76-7180-4546-aa80-d565caef642f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec099f69-5254-4579-bc03-180bf4bd6ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eaf714da0d64fda8d15717b452aef2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:05Z,use_quota=True,user_id='0c47afd4ff5f491ea4254be43ea6eba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2be5be-1bfb-4b81-9887-eb3f39bbc182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2be5be-1bfb-4b81-9887-eb3f39bbc182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e3efe8-a984-4cf9-91ff-fa56919e592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31e3efe8-a984-4cf9-91ff-fa56919e592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec099f69-5254-4579-bc03-180bf4bd6ba2', 'volume_name': 'volume-ec099f69-5254-4579-bc03-180bf4bd6ba2', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff92cb0-2101-403a-b0a8-70dc514c162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff92cb0-2101-403a-b0a8-70dc514c162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74ad63e-db72-4cee-ab52-6f20bff8da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:05 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Volume ec099f69-5254-4579-bc03-180bf4bd6ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec099f69-5254-4579-bc03-180bf4bd6ba2', 'volume_size': 1} Jul 05 18:26:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:06 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319" returned: 0 in 1.013s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] <== create_volume: return (2684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.688s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.374s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec099f69-5254-4579-bc03-180bf4bd6ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eaf714da0d64fda8d15717b452aef2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:05Z,use_quota=True,user_id='0c47afd4ff5f491ea4254be43ea6eba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Creating volume ec099f69-5254-4579-bc03-180bf4bd6ba2 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:26:06 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4245621c-af0a-4518-8386-7b53a2f7570f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:06 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 1073741824 Jul 05 18:26:06 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac3a44b-77c3-44b4-b161-cf7b71878bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:06 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Volume volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 (69c46dd3-c3c6-4a46-9591-bb56e4b3a319): created successfully Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac3a44b-77c3-44b4-b161-cf7b71878bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (bca8f002-df24-4b26-9c26-6d7a94ee8b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:06 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c4f20f08-3cec-4c5d-88d0-abbc20881169 tempest-VolumesActionsTest-628721459 None] Created volume successfully. Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Acquiring lock "cinder-69c46dd3-c3c6-4a46-9591-bb56e4b3a319-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Lock "cinder-69c46dd3-c3c6-4a46-9591-bb56e4b3a319-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Acquiring lock "cinder-quobyte-69c46dd3-c3c6-4a46-9591-bb56e4b3a319" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Lock "cinder-quobyte-69c46dd3-c3c6-4a46-9591-bb56e4b3a319" acquired by "delete_volume" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:07 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fffb58-f0ba-4318-995b-62c9ee6c3173]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:07 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 Jul 05 18:26:07 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:07 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 1073741824" returned: 0 in 1.364s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:07 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 Jul 05 18:26:07 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:08 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319" returned: 0 in 1.029s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:08 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319 Jul 05 18:26:08 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:08 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2" returned: 0 in 1.239s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] <== create_volume: return (2674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:26:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.677s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74ad63e-db72-4cee-ab52-6f20bff8da38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec099f69-5254-4579-bc03-180bf4bd6ba2', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdbe43c-887c-4752-8f78-13bb4c9caeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:08 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Volume volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 (ec099f69-5254-4579-bc03-180bf4bd6ba2): created successfully Jul 05 18:26:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cdbe43c-887c-4752-8f78-13bb4c9caeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Flow 'volume_create_manager' (f3aeb2d9-6fc4-40e4-ac99-9916219d2353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:08 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-795a2088-4812-4e7a-b090-7100f93cd150 tempest-VolumesListAdminTestJSON-1754422532 None] Created volume successfully. Jul 05 18:26:09 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-69c46dd3-c3c6-4a46-9591-bb56e4b3a319" returned: 0 in 0.952s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Lock "cinder-quobyte-69c46dd3-c3c6-4a46-9591-bb56e4b3a319" released by "delete_volume" :: held 2.063s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:09 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Created reservations ['567baa9b-7b76-4f82-92df-5e53a069f1e7', 'ab3a40d4-f859-45aa-8cad-332358e380da', '84dcd554-4cd3-4249-9a9d-07e363811e57', 'b90af89d-157d-45b4-896b-71c9ee11bc32'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:09 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:09 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Acquiring lock "cinder-ec099f69-5254-4579-bc03-180bf4bd6ba2-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Lock "cinder-ec099f69-5254-4579-bc03-180bf4bd6ba2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Acquiring lock "cinder-quobyte-ec099f69-5254-4579-bc03-180bf4bd6ba2" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Lock "cinder-quobyte-ec099f69-5254-4579-bc03-180bf4bd6ba2" acquired by "delete_volume" :: waited 0.054s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c6def1-ff94-4d61-bd3e-a472e64dd4c1]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "cinder-1d2ee8d8-3710-4778-bbe9-c298d07676e1-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-1d2ee8d8-3710-4778-bbe9-c298d07676e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:10 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 Jul 05 18:26:10 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "cinder-quobyte-1d2ee8d8-3710-4778-bbe9-c298d07676e1" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (e7bb8ce7-67e2-4b93-bcc5-a9137742bea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45eb941-372a-42db-a830-df6a17b51f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-quobyte-1d2ee8d8-3710-4778-bbe9-c298d07676e1" acquired by "delete_volume" :: waited 0.108s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9af8dd2-834b-4a10-9080-2ad708a1f28a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f45eb941-372a-42db-a830-df6a17b51f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1478724704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983d4ed7-c476-45c1-bc44-1652d8912224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:11Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee73c51-79bc-4796-ae0f-a6eb9d595119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee73c51-79bc-4796-ae0f-a6eb9d595119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c14893-bae4-4f5d-81d4-bf95415174bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c14893-bae4-4f5d-81d4-bf95415174bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983d4ed7-c476-45c1-bc44-1652d8912224', 'volume_name': 'volume-983d4ed7-c476-45c1-bc44-1652d8912224', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8e408f-2286-4691-81fb-4d8f2f79b010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:10 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8e408f-2286-4691-81fb-4d8f2f79b010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961308bd-cedb-47c6-a521-0f44ee798cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:10 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Volume 983d4ed7-c476-45c1-bc44-1652d8912224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983d4ed7-c476-45c1-bc44-1652d8912224', 'volume_size': 1} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1478724704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983d4ed7-c476-45c1-bc44-1652d8912224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:11Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Creating volume 983d4ed7-c476-45c1-bc44-1652d8912224 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:26:11 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:11 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224 1073741824 Jul 05 18:26:11 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.813s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:11 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Deleted volume successfully. Jul 05 18:26:11 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-03d63221-ddb3-4a55-be25-e609fe52a7cb tempest-VolumesActionsTest-1795192648 None] Lock "cinder-69c46dd3-c3c6-4a46-9591-bb56e4b3a319-delete_volume" released by "delete_volume" :: held 4.359s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:11 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 Jul 05 18:26:11 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:26:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:12 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:12 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:12 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2" returned: 0 in 1.920s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:12 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2 Jul 05 18:26:12 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:13 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224 1073741824" returned: 0 in 2.016s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:13 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1" returned: 0 in 2.004s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:13 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1 Jul 05 18:26:13 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:13 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224 Jul 05 18:26:13 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:13 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.704s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:26:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 8 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:26:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:26:14 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ec099f69-5254-4579-bc03-180bf4bd6ba2" returned: 0 in 2.477s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Lock "cinder-quobyte-ec099f69-5254-4579-bc03-180bf4bd6ba2" released by "delete_volume" :: held 4.524s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:14 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Created reservations ['1849e2c7-4eb9-46c1-b724-c4fd3ee24387', '57b8d206-ddea-48bf-9672-a04feee23052', '52a81fc9-53fc-4b1b-b6cf-903c82d32430', 'e6039230-c040-473b-a8d3-f33d7671a4a9'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:15 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1d2ee8d8-3710-4778-bbe9-c298d07676e1" returned: 0 in 2.111s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:15 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:15 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-quobyte-1d2ee8d8-3710-4778-bbe9-c298d07676e1" released by "delete_volume" :: held 4.469s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Created reservations ['650ab05c-6a2c-4344-8b53-733f96359e44', '49e73b80-96ea-47f8-b5a8-3bc289a3621f', '12ca9256-4089-4ec3-93a0-cde1711256da', '8517c592-92d3-43b8-810a-d90e64454519'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:15 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224" returned: 0 in 2.501s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] <== create_volume: return (4709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.725s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:15 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:15 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961308bd-cedb-47c6-a521-0f44ee798cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983d4ed7-c476-45c1-bc44-1652d8912224', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d366d4e4-db51-4dab-b7a0-41810b52769b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:15 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Volume volume-983d4ed7-c476-45c1-bc44-1652d8912224 (983d4ed7-c476-45c1-bc44-1652d8912224): created successfully Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d366d4e4-db51-4dab-b7a0-41810b52769b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (e7bb8ce7-67e2-4b93-bcc5-a9137742bea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:15 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-75485e1a-aae3-4885-9287-2556297800ee tempest-VolumesActionsTest-628721459 None] Created volume successfully. Jul 05 18:26:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Acquiring lock "cinder-983d4ed7-c476-45c1-bc44-1652d8912224-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Lock "cinder-983d4ed7-c476-45c1-bc44-1652d8912224-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Acquiring lock "cinder-quobyte-983d4ed7-c476-45c1-bc44-1652d8912224" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Lock "cinder-quobyte-983d4ed7-c476-45c1-bc44-1652d8912224" acquired by "delete_volume" :: waited 0.052s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "cinder-3e2e2340-6b88-4524-93d1-fd15510766b4-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fcc0fc-436c-497c-aa96-72bad9bfb688]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-3e2e2340-6b88-4524-93d1-fd15510766b4-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "cinder-quobyte-3e2e2340-6b88-4524-93d1-fd15510766b4" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:17 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-quobyte-3e2e2340-6b88-4524-93d1-fd15510766b4" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:17 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.973s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.460s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:17 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224 Jul 05 18:26:17 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Deleted volume successfully. Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c85e7e-6ac7-4058-bc34-9198716df0da]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-248c24cf-6732-493d-b2a9-b1145ee457be tempest-VolumesListAdminTestJSON-1754422532 None] Lock "cinder-ec099f69-5254-4579-bc03-180bf4bd6ba2-delete_volume" released by "delete_volume" :: held 7.091s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Deleted volume successfully. Jul 05 18:26:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f03412da-6f1c-48b8-95c4-266802760f14 tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-1d2ee8d8-3710-4778-bbe9-c298d07676e1-delete_volume" released by "delete_volume" :: held 6.768s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:17 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4 Jul 05 18:26:17 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:18 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224" returned: 0 in 1.775s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:18 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224 Jul 05 18:26:18 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:18 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4" returned: 0 in 1.676s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:18 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4 Jul 05 18:26:18 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:19 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-983d4ed7-c476-45c1-bc44-1652d8912224" returned: 0 in 1.221s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Lock "cinder-quobyte-983d4ed7-c476-45c1-bc44-1652d8912224" released by "delete_volume" :: held 3.125s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Created reservations ['c7f1ee4d-a408-4428-adc8-9134ce809f80', 'f06de272-781c-449b-abcb-079d2bbda7a3', '70d27c22-8049-40e3-8875-0ee223d6e798', '11c8d125-e9e7-47e2-b09d-1d6607a73044'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:20 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:20 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:20 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3e2e2340-6b88-4524-93d1-fd15510766b4" returned: 0 in 1.630s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-quobyte-3e2e2340-6b88-4524-93d1-fd15510766b4" released by "delete_volume" :: held 3.417s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Created reservations ['dad2233b-e2eb-4b04-a82d-91d256c89f3f', 'cb77c0d8-d87c-4599-84c2-f7fb55b1fa17', '050fb5ec-e60b-4f0d-aeb9-4be5960dff16', 'ba3f40ac-d824-4037-ac13-11492e292059'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:20 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:20 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:21 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.081s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:21 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:21 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Deleted volume successfully. Jul 05 18:26:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6cb2b6b6-3eeb-4ba6-a8b3-817b0476c94b tempest-VolumesActionsTest-1795192648 None] Lock "cinder-983d4ed7-c476-45c1-bc44-1652d8912224-delete_volume" released by "delete_volume" :: held 4.806s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "cinder-b672ba08-cb12-4ba1-b073-e7578b6f05c9-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-b672ba08-cb12-4ba1-b073-e7578b6f05c9-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "cinder-quobyte-b672ba08-cb12-4ba1-b073-e7578b6f05c9" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-quobyte-b672ba08-cb12-4ba1-b073-e7578b6f05c9" acquired by "delete_volume" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:22 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b652a9dd-a7d7-40bd-b180-468cc580d2ab]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:22 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 Jul 05 18:26:22 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:22 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.883s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:22 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Deleted volume successfully. Jul 05 18:26:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-09ed9bb0-91ba-4b66-a262-340d810691fa tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-3e2e2340-6b88-4524-93d1-fd15510766b4-delete_volume" released by "delete_volume" :: held 5.918s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (c1ff2eab-eb24-41e6-8fa3-abbaac802d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14efb71b-d05e-40f5-8445-92fa8f642137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14efb71b-d05e-40f5-8445-92fa8f642137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1301801439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36de8211-b96c-4bcf-a789-2759e85f18ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:23Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5519a8e7-2d71-4992-9c73-efa6c61fdbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5519a8e7-2d71-4992-9c73-efa6c61fdbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed247b43-8d90-40e2-a5d5-4183f36bc50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed247b43-8d90-40e2-a5d5-4183f36bc50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36de8211-b96c-4bcf-a789-2759e85f18ef', 'volume_name': 'volume-36de8211-b96c-4bcf-a789-2759e85f18ef', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25478129-2c0b-47de-a79a-76cb90368784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25478129-2c0b-47de-a79a-76cb90368784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432983c9-8cbf-46da-ac1d-de3568ceb9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:23 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Volume 36de8211-b96c-4bcf-a789-2759e85f18ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36de8211-b96c-4bcf-a789-2759e85f18ef', 'volume_size': 1} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1301801439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36de8211-b96c-4bcf-a789-2759e85f18ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:23Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Creating volume 36de8211-b96c-4bcf-a789-2759e85f18ef {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:26:23 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:23 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef 1073741824 Jul 05 18:26:23 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:23 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9" returned: 0 in 1.590s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:23 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9 Jul 05 18:26:23 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:24 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b672ba08-cb12-4ba1-b073-e7578b6f05c9" returned: 0 in 1.055s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:26:24 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Flow 'volume_create_manager' (6ab4d857-83f2-44cb-a2cf-1bd4b75f2e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bb1cd3-c830-4577-9c46-9743aba16b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef 1073741824" returned: 0 in 1.457s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-quobyte-b672ba08-cb12-4ba1-b073-e7578b6f05c9" released by "delete_volume" :: held 2.754s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bb1cd3-c830-4577-9c46-9743aba16b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-272604303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789fd172-3be6-4f59-825c-520f5101d170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad9c7881df9496da1855cb0502e0932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:25Z,use_quota=True,user_id='f48e7bd349b148ff853d434a908d1e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ea8a08-9ca8-4b43-a87e-2f3ae9fa46c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ea8a08-9ca8-4b43-a87e-2f3ae9fa46c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b441fb1-d0fe-46c9-9562-03c2bf775159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b441fb1-d0fe-46c9-9562-03c2bf775159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789fd172-3be6-4f59-825c-520f5101d170', 'volume_name': 'volume-789fd172-3be6-4f59-825c-520f5101d170', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eaa0b90-9e08-47c5-86fb-38a427ddbe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eaa0b90-9e08-47c5-86fb-38a427ddbe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7e5918-8def-4f3f-a7d3-b53095acffc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:24 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Volume 789fd172-3be6-4f59-825c-520f5101d170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789fd172-3be6-4f59-825c-520f5101d170', 'volume_size': 1} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:24 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Created reservations ['563a59f2-0891-4c51-9788-50174d6d66eb', '95b9a9ab-503d-43b2-8d29-40174054ad99', 'ab82b3ca-a531-429f-92a0-6daae4d7422d', '2d395d55-eb40-44d6-a8d9-6bb197ea85c5'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:24 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef Jul 05 18:26:24 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:25 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:25 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:25 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.797s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Deleted volume successfully. Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9d500b63-613d-48c4-8070-a7c927b533a4 tempest-VolumesListAdminTestJSON-201290706 None] Lock "cinder-b672ba08-cb12-4ba1-b073-e7578b6f05c9-delete_volume" released by "delete_volume" :: held 4.039s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:25 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef" returned: 0 in 1.002s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] <== create_volume: return (2564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.571s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-272604303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789fd172-3be6-4f59-825c-520f5101d170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad9c7881df9496da1855cb0502e0932',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:25Z,use_quota=True,user_id='f48e7bd349b148ff853d434a908d1e09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Creating volume 789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:26:25 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:25 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 1073741824 Jul 05 18:26:25 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432983c9-8cbf-46da-ac1d-de3568ceb9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36de8211-b96c-4bcf-a789-2759e85f18ef', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e991134-0b09-483f-960b-919504c092f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:26 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Volume volume-36de8211-b96c-4bcf-a789-2759e85f18ef (36de8211-b96c-4bcf-a789-2759e85f18ef): created successfully Jul 05 18:26:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e991134-0b09-483f-960b-919504c092f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (c1ff2eab-eb24-41e6-8fa3-abbaac802d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:26 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-bf76fae9-8dd9-4805-b7b5-4c9a4653a47d tempest-VolumesActionsTest-628721459 None] Created volume successfully. Jul 05 18:26:27 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 1073741824" returned: 0 in 1.241s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Acquiring lock "cinder-36de8211-b96c-4bcf-a789-2759e85f18ef-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:27 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 Jul 05 18:26:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Lock "cinder-36de8211-b96c-4bcf-a789-2759e85f18ef-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:27 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Acquiring lock "cinder-quobyte-36de8211-b96c-4bcf-a789-2759e85f18ef" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Lock "cinder-quobyte-36de8211-b96c-4bcf-a789-2759e85f18ef" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3336f3e-4eff-4992-845b-c67f8f3d1b6b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:27 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef Jul 05 18:26:27 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:28 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170" returned: 0 in 0.897s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:26:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7e5918-8def-4f3f-a7d3-b53095acffc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789fd172-3be6-4f59-825c-520f5101d170', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff553f5f-19db-40cb-82c2-689e53bb2cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:28 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Volume volume-789fd172-3be6-4f59-825c-520f5101d170 (789fd172-3be6-4f59-825c-520f5101d170): created successfully Jul 05 18:26:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff553f5f-19db-40cb-82c2-689e53bb2cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Flow 'volume_create_manager' (6ab4d857-83f2-44cb-a2cf-1bd4b75f2e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:28 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0d09a34e-32c1-4569-b2ed-25d7498c0f61 tempest-VolumesActionsTest-803818908 None] Created volume successfully. Jul 05 18:26:28 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef" returned: 0 in 1.007s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:28 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef Jul 05 18:26:28 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:29 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-36de8211-b96c-4bcf-a789-2759e85f18ef" returned: 0 in 0.727s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Lock "cinder-quobyte-36de8211-b96c-4bcf-a789-2759e85f18ef" released by "delete_volume" :: held 1.800s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:29 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Created reservations ['67d0379f-6278-4ece-94a3-962a0de0ecdc', '4e62c2ca-55a9-4aa4-948e-2dcf124e735f', '1b47b8a5-e15c-421e-ae74-123f5a5dc91b', 'dd8b4f65-81c7-4046-b6e1-23570c9e3a19'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:29 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:29 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (74ad7064-38b2-40dd-a3e7-5d67e13747c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562532bb-7d60-49bc-9345-1f8372a7152b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:30 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.969s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Deleted volume successfully. Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562532bb-7d60-49bc-9345-1f8372a7152b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-155405581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a7ec45-ba17-438b-9ed7-37659020527f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:30Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdfe00d-c9c5-4806-887e-3808677bd39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fdfe00d-c9c5-4806-887e-3808677bd39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66594d40-61db-48d6-b853-c703397dbe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66594d40-61db-48d6-b853-c703397dbe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a7ec45-ba17-438b-9ed7-37659020527f', 'volume_name': 'volume-37a7ec45-ba17-438b-9ed7-37659020527f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b870b6-24b2-4d80-8a3b-c7b6efb0ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b870b6-24b2-4d80-8a3b-c7b6efb0ff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef1c4f5-101c-4d3f-a086-ed9d3cf4fe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:30 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Volume 37a7ec45-ba17-438b-9ed7-37659020527f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a7ec45-ba17-438b-9ed7-37659020527f', 'volume_size': 1} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-155405581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a7ec45-ba17-438b-9ed7-37659020527f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2f0f9004fb454ca56deaa744555b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:30Z,use_quota=True,user_id='5a8732ca2eb0413ca659373d195a1edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Creating volume 37a7ec45-ba17-438b-9ed7-37659020527f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:26:30 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:30 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f 1073741824 Jul 05 18:26:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f7436e4d-f1ad-4fd9-af09-35be37045dfc tempest-VolumesActionsTest-1795192648 None] Lock "cinder-36de8211-b96c-4bcf-a789-2759e85f18ef-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:30 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:31 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f 1073741824" returned: 0 in 1.064s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:31 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f Jul 05 18:26:31 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:32 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f" returned: 0 in 0.721s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:26:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef1c4f5-101c-4d3f-a086-ed9d3cf4fe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a7ec45-ba17-438b-9ed7-37659020527f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b6007d-a461-421d-983f-c21771014128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:32 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Volume volume-37a7ec45-ba17-438b-9ed7-37659020527f (37a7ec45-ba17-438b-9ed7-37659020527f): created successfully Jul 05 18:26:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b6007d-a461-421d-983f-c21771014128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Flow 'volume_create_manager' (74ad7064-38b2-40dd-a3e7-5d67e13747c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-831df898-3424-4609-97f9-2494875109d7 tempest-VolumesActionsTest-628721459 None] Created volume successfully. Jul 05 18:26:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Acquiring lock "cinder-37a7ec45-ba17-438b-9ed7-37659020527f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Lock "cinder-37a7ec45-ba17-438b-9ed7-37659020527f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Acquiring lock "cinder-quobyte-37a7ec45-ba17-438b-9ed7-37659020527f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Lock "cinder-quobyte-37a7ec45-ba17-438b-9ed7-37659020527f" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:34 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66942f5-9e2e-4bee-9bca-c18fed0781c6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:34 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f Jul 05 18:26:34 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Flow 'volume_create_manager' (58b81026-8f92-42ee-b399-12d1f3003d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee59191-258d-4188-82a7-6b7732b3cfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ee59191-258d-4188-82a7-6b7732b3cfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-112399876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa93674b-ca86-4399-9cbd-a3e0a60eefc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6871e7f8e4774a5431d865883fc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:35Z,use_quota=True,user_id='efe84a2956de47269759e084b90f230f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e623a3-db51-4fce-a122-e3004167c0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e623a3-db51-4fce-a122-e3004167c0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e8b6f6-2e49-4f36-bee3-8ca44c3ee288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.image.glance [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Creating Keystone auth plugin from conf {{(pid=86664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 18:26:35 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f" returned: 0 in 1.164s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:35 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f Jul 05 18:26:35 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e8b6f6-2e49-4f36-bee3-8ca44c3ee288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa93674b-ca86-4399-9cbd-a3e0a60eefc6', 'volume_name': 'volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af75ac5a-1f22-4544-b185-f59dfe0b1bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af75ac5a-1f22-4544-b185-f59dfe0b1bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796e30a2-f4cb-45c8-8100-287e01bb4dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:36 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Volume aa93674b-ca86-4399-9cbd-a3e0a60eefc6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 18:26:36 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Trying to clone aa93674b-ca86-4399-9cbd-a3e0a60eefc6 from image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]). {{(pid=86664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 18:26:36 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 18:26:36 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Image download 20.69 MB at 20.69 MB/s Jul 05 18:26:36 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[10db6392-06d9-4272-90ab-7466d803985a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:37 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD Jul 05 18:26:37 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:37 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-37a7ec45-ba17-438b-9ed7-37659020527f" returned: 0 in 1.536s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Lock "cinder-quobyte-37a7ec45-ba17-438b-9ed7-37659020527f" released by "delete_volume" :: held 2.780s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:37 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Created reservations ['4b090e67-f9ea-4e70-bf94-652dd4de7dc3', 'e2a35f90-d418-469d-b679-2ca7362b82e6', 'e8304927-68cb-43d8-87b0-d2d5555e7584', '0a190005-7218-4f50-b052-fd962ef6aa84'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:37 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:37 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:38 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD" returned: 0 in 1.415s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:38 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Temporary image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 is fetched for user efe84a2956de47269759e084b90f230f. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 18:26:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22cf8d0-c588-4111-af0c-c0f2577ec86a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:38 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD Jul 05 18:26:38 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:38 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.059s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:38 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:38 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Deleted volume successfully. Jul 05 18:26:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2449888b-95d4-4373-87d2-43e7da19c37b tempest-VolumesActionsTest-628721459 None] Lock "cinder-37a7ec45-ba17-438b-9ed7-37659020527f-delete_volume" released by "delete_volume" :: held 4.309s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:39 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD" returned: 0 in 1.013s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-112399876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa93674b-ca86-4399-9cbd-a3e0a60eefc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed6871e7f8e4774a5431d865883fc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:35Z,use_quota=True,user_id='efe84a2956de47269759e084b90f230f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Creating volume aa93674b-ca86-4399-9cbd-a3e0a60eefc6 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:26:39 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:26:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:39 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 1073741824 Jul 05 18:26:39 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Flow 'volume_create_manager' (d4fa8526-aaa8-43d8-993a-6b364c7c5e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea1898-2392-4ff6-bd46-efcfdfffdb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea1898-2392-4ff6-bd46-efcfdfffdb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1942942950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6dba96-8784-4a3a-84b0-b83d29181d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25a9b155ec049cbaa5df3eb6452e48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:40Z,use_quota=True,user_id='80dfc9e847d1497a9bed01650fa8ad09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236932d4-6001-4061-89fd-15c995edf910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236932d4-6001-4061-89fd-15c995edf910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d162013-36a1-4d78-b2ca-f11facbc6ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d162013-36a1-4d78-b2ca-f11facbc6ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6dba96-8784-4a3a-84b0-b83d29181d33', 'volume_name': 'volume-af6dba96-8784-4a3a-84b0-b83d29181d33', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a36e24b-67b5-4806-ac95-d1089219b97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a36e24b-67b5-4806-ac95-d1089219b97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1cbc81-c89c-44ca-bff1-ba307893d7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:40 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Volume af6dba96-8784-4a3a-84b0-b83d29181d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6dba96-8784-4a3a-84b0-b83d29181d33', 'volume_size': 1} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:40 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 1073741824" returned: 0 in 1.179s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:40 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 Jul 05 18:26:40 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:41 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" returned: 0 in 0.989s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1942942950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6dba96-8784-4a3a-84b0-b83d29181d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25a9b155ec049cbaa5df3eb6452e48e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:26:40Z,use_quota=True,user_id='80dfc9e847d1497a9bed01650fa8ad09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Creating volume af6dba96-8784-4a3a-84b0-b83d29181d33 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:26:41 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:41 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 1073741824 Jul 05 18:26:41 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Attempting download of 8ef91c9d-cbe2-449c-b464-74cfa5f50992 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}])) to volume aa93674b-ca86-4399-9cbd-a3e0a60eefc6. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed8acab-698f-45bd-8197-445ed9c2f4cd]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_h9ntmwlf {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:41 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_h9ntmwlf Jul 05 18:26:41 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:43 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:43 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_h9ntmwlf" returned: 0 in 1.597s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_h9ntmwlf {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 1073741824" returned: 0 in 1.738s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:43 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_h9ntmwlf Jul 05 18:26:43 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:43 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 Jul 05 18:26:43 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:44 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33" returned: 0 in 0.986s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] <== create_volume: return (2892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.896s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1cbc81-c89c-44ca-bff1-ba307893d7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6dba96-8784-4a3a-84b0-b83d29181d33', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47c9c31-7dab-4d90-b3ac-0cae7774782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:44 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Volume volume-af6dba96-8784-4a3a-84b0-b83d29181d33 (af6dba96-8784-4a3a-84b0-b83d29181d33): created successfully Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47c9c31-7dab-4d90-b3ac-0cae7774782c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Flow 'volume_create_manager' (d4fa8526-aaa8-43d8-993a-6b364c7c5e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:44 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-72c0eef0-841e-448e-be74-b8ffdbfd9215 tempest-AttachVolumeNegativeTest-503091028 None] Created volume successfully. Jul 05 18:26:44 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_h9ntmwlf" returned: 1 in 1.402s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_h9ntmwlf' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[317b988a-4483-4ace-a211-aa69c3111562]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:44 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD Jul 05 18:26:44 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:46 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD" returned: 0 in 1.259s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:46 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] 8ef91c9d-cbe2-449c-b464-74cfa5f50992 was qcow2, converting to raw {{(pid=86664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 18:26:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:46 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 Jul 05 18:26:46 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3248e175-7467-423c-b2cf-795d074774bd tempest-VolumesActionsTest-803818908 None] Acquiring lock "cinder-789fd172-3be6-4f59-825c-520f5101d170" by "attach_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3248e175-7467-423c-b2cf-795d074774bd tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170" acquired by "attach_volume" :: waited 0.040s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3248e175-7467-423c-b2cf-795d074774bd tempest-VolumesActionsTest-803818908 None] Attaching volume 789fd172-3be6-4f59-825c-520f5101d170 to instance 137a097b-f713-4e38-aa69-e2eac7c1e593 at mountpoint /dev/vdb on host None. Jul 05 18:26:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3248e175-7467-423c-b2cf-795d074774bd tempest-VolumesActionsTest-803818908 None] Attach volume completed successfully. Jul 05 18:26:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3248e175-7467-423c-b2cf-795d074774bd tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170" released by "attach_volume" :: held 0.215s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6e315308-3f08-4708-92e2-b3872ffe7b46 tempest-VolumesActionsTest-803818908 None] Acquiring lock "cinder-789fd172-3be6-4f59-825c-520f5101d170-detach_volume" by "detach_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6e315308-3f08-4708-92e2-b3872ffe7b46 tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6e315308-3f08-4708-92e2-b3872ffe7b46 tempest-VolumesActionsTest-803818908 None] Detaching volume 789fd172-3be6-4f59-825c-520f5101d170 from instance 137a097b-f713-4e38-aa69-e2eac7c1e593. Jul 05 18:26:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6e315308-3f08-4708-92e2-b3872ffe7b46 tempest-VolumesActionsTest-803818908 None] Detach volume completed successfully. Jul 05 18:26:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6e315308-3f08-4708-92e2-b3872ffe7b46 tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170-detach_volume" released by "detach_volume" :: held 0.216s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-d50f5b99-cbfc-4b7f-b019-481218dd5740 req-2514825c-84a5-4a0f-a3b4-7021642fe06f tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-d50f5b99-cbfc-4b7f-b019-481218dd5740 req-2514825c-84a5-4a0f-a3b4-7021642fe06f tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[35560d6e-030d-4fd1-bb53-98fa3fcf1e90]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d50f5b99-cbfc-4b7f-b019-481218dd5740 req-2514825c-84a5-4a0f-a3b4-7021642fe06f tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:49 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" returned: 0 in 3.783s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:49 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_exy8e0g5devstack@QuobyteHD, size 112.00 MB, duration 3.78 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:26:49 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Converted 112.00 MB image at 29.59 MB/s Jul 05 18:26:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:49 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 1G Jul 05 18:26:49 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:49 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 Jul 05 18:26:49 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:50 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 1G" returned: 0 in 1.031s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:50 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:50 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad4b227-c8b9-4acc-90c4-985eedac1d05]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d50f5b99-cbfc-4b7f-b019-481218dd5740 req-2514825c-84a5-4a0f-a3b4-7021642fe06f tempest-AttachVolumeNegativeTest-503091028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33" returned: 0 in 1.268s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-d50f5b99-cbfc-4b7f-b019-481218dd5740 req-2514825c-84a5-4a0f-a3b4-7021642fe06f tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.304s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-d50f5b99-cbfc-4b7f-b019-481218dd5740 req-2514825c-84a5-4a0f-a3b4-7021642fe06f tempest-AttachVolumeNegativeTest-503091028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-af6dba96-8784-4a3a-84b0-b83d29181d33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '242ad54d-8b65-459b-aec9-7187bee7b093', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:26:51 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 Jul 05 18:26:51 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:51 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-d50f5b99-cbfc-4b7f-b019-481218dd5740 req-2514825c-84a5-4a0f-a3b4-7021642fe06f tempest-AttachVolumeNegativeTest-503091028 None] attachment_update completed successfully. Jul 05 18:26:52 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" returned: 0 in 1.232s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:52 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 Jul 05 18:26:52 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:53 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" returned: 1 in 1.081s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Downloaded image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}])) to volume aa93674b-ca86-4399-9cbd-a3e0a60eefc6 successfully. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Temporary image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 for user efe84a2956de47269759e084b90f230f is deleted. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Marking volume aa93674b-ca86-4399-9cbd-a3e0a60eefc6 as bootable. {{(pid=86664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=93,cinder:UPDATE=129,cinder:INSERT=27,cinder:DELETE=7 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Copying metadata from image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 to aa93674b-ca86-4399-9cbd-a3e0a60eefc6. {{(pid=86664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Creating volume glance metadata for volume aa93674b-ca86-4399-9cbd-a3e0a60eefc6 backed by image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=111,cinder:SELECT=81,cinder:INSERT=28,cinder:DELETE=14 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796e30a2-f4cb-45c8-8100-287e01bb4dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164c9e99-e2a0-4d4d-bd65-afd4eec477d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:26:53 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Volume volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 (aa93674b-ca86-4399-9cbd-a3e0a60eefc6): created successfully Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164c9e99-e2a0-4d4d-bd65-afd4eec477d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:26:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Flow 'volume_create_manager' (58b81026-8f92-42ee-b399-12d1f3003d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:26:53 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-bb18ef0f-cc2c-491b-8759-537e2c8cde8d tempest-VolumesImageMetadata-1592839318 None] Created volume successfully. Jul 05 18:26:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Acquiring lock "cinder-aa93674b-ca86-4399-9cbd-a3e0a60eefc6-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Lock "cinder-aa93674b-ca86-4399-9cbd-a3e0a60eefc6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Acquiring lock "cinder-quobyte-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:26:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Lock "cinder-quobyte-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:26:54 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6e8290-7f63-44a4-b08e-3449706432e0]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:26:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:54 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 Jul 05 18:26:54 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:55 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" returned: 0 in 0.920s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:55 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 Jul 05 18:26:55 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:56 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" returned: 1 in 0.995s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:26:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:56 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6 Jul 05 18:26:56 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:57 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" returned: 0 in 0.747s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Lock "cinder-quobyte-aa93674b-ca86-4399-9cbd-a3e0a60eefc6" released by "delete_volume" :: held 2.757s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Created reservations ['78dfeb3d-3ed0-462a-a9a8-4dc5d3e8e009', 'e95e8f74-a62e-4cc4-a8b1-dd260c0d90ae', '80212b91-4d8d-4289-bb67-31e2dae41076', '4082ca04-8ba1-4d88-9478-721b107aface'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:26:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-89d43f64-050b-4212-ad90-8dce8d8c284d req-fe77f0cd-8a43-4c67-b606-2924d36317fe tempest-AttachVolumeNegativeTest-503091028 None] Terminate volume connection completed successfully. Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-89d43f64-050b-4212-ad90-8dce8d8c284d req-fe77f0cd-8a43-4c67-b606-2924d36317fe tempest-AttachVolumeNegativeTest-503091028 None] Deleting attachment 242ad54d-8b65-459b-aec9-7187bee7b093. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:26:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:26:57 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:26:57 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:26:58 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 05 18:26:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.899s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:26:58 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:26:58 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Deleted volume successfully. Jul 05 18:26:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-44602989-bbaf-45bf-bc86-ad0ef0dd0277 tempest-VolumesImageMetadata-1592839318 None] Lock "cinder-aa93674b-ca86-4399-9cbd-a3e0a60eefc6-delete_volume" released by "delete_volume" :: held 4.014s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Flow 'volume_create_manager' (864578f9-7695-4801-8bf3-38cae2ac620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f5e5dc-4b11-41e5-9eab-2b1d40febe37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f5e5dc-4b11-41e5-9eab-2b1d40febe37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1242464963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702211a4-77eb-42b3-8731-b94ccb0fce8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d33086ab844d16bf509e8bc0956e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:27:01Z,use_quota=True,user_id='bc4d39a461cc4d43859b062235235372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa48979-f830-4f05-96f7-be0948bca4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa48979-f830-4f05-96f7-be0948bca4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b795d4-a77c-48f9-9494-cd5cb97687e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b795d4-a77c-48f9-9494-cd5cb97687e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702211a4-77eb-42b3-8731-b94ccb0fce8b', 'volume_name': 'volume-702211a4-77eb-42b3-8731-b94ccb0fce8b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384de374-525a-4dad-8ea5-5a68eb5e2eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (384de374-525a-4dad-8ea5-5a68eb5e2eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88236fc6-4b9c-48ae-a46c-6d9141eec81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:00 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Volume 702211a4-77eb-42b3-8731-b94ccb0fce8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702211a4-77eb-42b3-8731-b94ccb0fce8b', 'volume_size': 1} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1242464963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702211a4-77eb-42b3-8731-b94ccb0fce8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d33086ab844d16bf509e8bc0956e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:27:01Z,use_quota=True,user_id='bc4d39a461cc4d43859b062235235372',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Creating volume 702211a4-77eb-42b3-8731-b94ccb0fce8b {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:27:00 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:27:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:00 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b 1073741824 Jul 05 18:27:00 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:02 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b 1073741824" returned: 0 in 1.230s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:02 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b Jul 05 18:27:02 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Flow 'volume_create_manager' (d547a628-3238-49ef-b471-fae8512a7416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fef1aa5-1424-401b-acb8-be0fb457ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fef1aa5-1424-401b-acb8-be0fb457ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-741900208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebb7679-ddfc-4276-8ffe-cb9d7eba042d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638bb9849d454ae7868e55b42cad2775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:27:03Z,use_quota=True,user_id='b0a9d033e6d340549bc379305426534c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d081933-ddb0-4942-9887-370a52028df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d081933-ddb0-4942-9887-370a52028df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9aac8d-d8bc-4c90-b446-dfbb2eb812a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9aac8d-d8bc-4c90-b446-dfbb2eb812a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebb7679-ddfc-4276-8ffe-cb9d7eba042d', 'volume_name': 'volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1f6e75-4e26-4353-aae5-93af2096d102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1f6e75-4e26-4353-aae5-93af2096d102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77804c4c-7615-4f2b-a585-9fd4ad202882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:02 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Volume 2ebb7679-ddfc-4276-8ffe-cb9d7eba042d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d', 'volume_size': 1} Jul 05 18:27:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:03 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b" returned: 0 in 0.908s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.410s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-741900208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebb7679-ddfc-4276-8ffe-cb9d7eba042d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638bb9849d454ae7868e55b42cad2775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:27:03Z,use_quota=True,user_id='b0a9d033e6d340549bc379305426534c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Creating volume 2ebb7679-ddfc-4276-8ffe-cb9d7eba042d {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:27:03 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:03 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d 1073741824 Jul 05 18:27:03 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88236fc6-4b9c-48ae-a46c-6d9141eec81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702211a4-77eb-42b3-8731-b94ccb0fce8b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1726c9f4-7bba-4a2c-8e24-02a662dac0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:03 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Volume volume-702211a4-77eb-42b3-8731-b94ccb0fce8b (702211a4-77eb-42b3-8731-b94ccb0fce8b): created successfully Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1726c9f4-7bba-4a2c-8e24-02a662dac0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Flow 'volume_create_manager' (864578f9-7695-4801-8bf3-38cae2ac620a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:27:03 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8d8c8f1e-818e-4fdc-93fd-8f28c863843d tempest-AbsoluteLimitsTests-546586207 None] Created volume successfully. Jul 05 18:27:04 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d 1073741824" returned: 0 in 1.081s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:04 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d Jul 05 18:27:04 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Acquiring lock "cinder-702211a4-77eb-42b3-8731-b94ccb0fce8b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Lock "cinder-702211a4-77eb-42b3-8731-b94ccb0fce8b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Acquiring lock "cinder-quobyte-702211a4-77eb-42b3-8731-b94ccb0fce8b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Lock "cinder-quobyte-702211a4-77eb-42b3-8731-b94ccb0fce8b" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:04 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[deed3889-a837-4692-b591-e56b23371c74]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:04 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b Jul 05 18:27:04 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:05 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" returned: 0 in 0.963s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:27:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77804c4c-7615-4f2b-a585-9fd4ad202882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e42ae7-9e3d-470e-a541-80662de9409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:05 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Volume volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d (2ebb7679-ddfc-4276-8ffe-cb9d7eba042d): created successfully Jul 05 18:27:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e42ae7-9e3d-470e-a541-80662de9409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Flow 'volume_create_manager' (d547a628-3238-49ef-b471-fae8512a7416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:27:05 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c6a25130-863e-49bc-905d-977345da500d tempest-SnapshotMetadataTestJSON-934169171 None] Created volume successfully. Jul 05 18:27:05 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b" returned: 0 in 1.217s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:05 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b Jul 05 18:27:05 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Creating offline snapshot 21583a45-a8b5-4e60-9711-fbb7a84d749a of volume 2ebb7679-ddfc-4276-8ffe-cb9d7eba042d {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:27:06 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae989b8-35c5-49cc-873e-6799330a1ef7]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:06 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d Jul 05 18:27:06 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:06 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-702211a4-77eb-42b3-8731-b94ccb0fce8b" returned: 0 in 1.048s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Lock "cinder-quobyte-702211a4-77eb-42b3-8731-b94ccb0fce8b" released by "delete_volume" :: held 2.337s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:06 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Created reservations ['da00de9e-2aea-4ea9-b5a5-647038cced3d', '4404c4ad-c7cb-4fda-b928-94e9b657fcde', '1d887da3-b12c-4744-b7ce-578709606b96', 'a15a6198-0fa3-4450-8aa0-37a0917e4a12'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:07 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:27:07 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:07 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" returned: 0 in 1.284s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:07 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a 1G Jul 05 18:27:07 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:07 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.904s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:27:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Deleted volume successfully. Jul 05 18:27:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82941464-7a01-467d-bf08-bc63a23d345d tempest-AbsoluteLimitsTests-546586207 None] Lock "cinder-702211a4-77eb-42b3-8731-b94ccb0fce8b-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:08 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a 1G" returned: 0 in 1.168s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:08 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a Jul 05 18:27:08 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:09 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a" returned: 0 in 0.966s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:09 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a is being set with open permissions: ugo+rw Jul 05 18:27:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:09 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a Jul 05 18:27:09 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "cinder-af6dba96-8784-4a3a-84b0-b83d29181d33-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-af6dba96-8784-4a3a-84b0-b83d29181d33-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "cinder-quobyte-af6dba96-8784-4a3a-84b0-b83d29181d33" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-quobyte-af6dba96-8784-4a3a-84b0-b83d29181d33" acquired by "delete_volume" :: waited 0.031s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:10 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[55213907-d26f-4756-af84-c87dabec0c63]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:10 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 Jul 05 18:27:10 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:10 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a" returned: 0 in 0.971s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:10 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.info Jul 05 18:27:10 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:11 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33" returned: 0 in 1.215s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:11 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33 Jul 05 18:27:11 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:11 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.info" returned: 0 in 1.251s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:11 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.info is being set with open permissions: ugo+rw Jul 05 18:27:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:11 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.info Jul 05 18:27:11 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:12 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:27:12 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:12 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af6dba96-8784-4a3a-84b0-b83d29181d33" returned: 0 in 1.410s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-quobyte-af6dba96-8784-4a3a-84b0-b83d29181d33" released by "delete_volume" :: held 2.719s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Created reservations ['a0690b3c-dc2e-4d96-b61e-f68d7354c919', 'cbbb7fc6-3ab7-4432-8636-34e0c7d2b587', '6e8a6175-d65c-4129-9cee-91b9ed0d467e', '68b141ae-de40-4117-8c4f-7e2c2236e94f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:12 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:27:12 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:13 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.info" returned: 0 in 1.113s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.885s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9d1812e9-040e-4073-8443-2c7d387bc256 tempest-SnapshotMetadataTestJSON-934169171 None] Create snapshot completed successfully Jul 05 18:27:13 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.149s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "cinder-08e4ee95-3516-40cb-a2a0-ee98a8733822-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-08e4ee95-3516-40cb-a2a0-ee98a8733822-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "cinder-quobyte-08e4ee95-3516-40cb-a2a0-ee98a8733822" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-quobyte-08e4ee95-3516-40cb-a2a0-ee98a8733822" acquired by "delete_volume" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[657bdfed-ce71-4fc2-8315-9280d7b868b0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:13 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.021s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:27:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Deleted volume successfully. Jul 05 18:27:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ddbdbc6f-6584-4683-b351-2240cfb41a95 tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-af6dba96-8784-4a3a-84b0-b83d29181d33-delete_volume" released by "delete_volume" :: held 4.098s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:14 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 Jul 05 18:27:14 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:15 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822" returned: 0 in 1.328s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:15 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822 Jul 05 18:27:15 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Acquiring lock "cinder-21583a45-a8b5-4e60-9711-fbb7a84d749a-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-21583a45-a8b5-4e60-9711-fbb7a84d749a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Acquiring lock "cinder-quobyte-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-quobyte-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Acquiring lock "cinder-quobyte-21583a45-a8b5-4e60-9711-fbb7a84d749a" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-quobyte-21583a45-a8b5-4e60-9711-fbb7a84d749a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Deleting offline snapshot 21583a45-a8b5-4e60-9711-fbb7a84d749a of volume 2ebb7679-ddfc-4276-8ffe-cb9d7eba042d {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] snapshot_file for this snap is: volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92c30d3-ef35-4a3b-84c4-246b2353e268]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Flow 'volume_create_manager' (ea1f1b92-771c-4797-8b5e-6509c5a8d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297f81f6-7087-46b5-971f-e05d75a63013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297f81f6-7087-46b5-971f-e05d75a63013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-404003579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77e7d99-9fff-49d2-aa81-4313c2473c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d047da84bcb428dbd8ab8e1f36bedbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:27:16Z,use_quota=True,user_id='062fd9f932bd4beca7f656457147e8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ec4c26-a7e9-4ee6-9109-21137909d5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ec4c26-a7e9-4ee6-9109-21137909d5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed09963f-cca8-42cf-b392-3ff6ae7cee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed09963f-cca8-42cf-b392-3ff6ae7cee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77e7d99-9fff-49d2-aa81-4313c2473c6f', 'volume_name': 'volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899abd54-0644-4b74-88da-437afff4bc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (899abd54-0644-4b74-88da-437afff4bc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352687bc-6f41-464e-ad25-7ea661248a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:15 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Volume c77e7d99-9fff-49d2-aa81-4313c2473c6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f', 'volume_size': 1} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-404003579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77e7d99-9fff-49d2-aa81-4313c2473c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d047da84bcb428dbd8ab8e1f36bedbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:27:16Z,use_quota=True,user_id='062fd9f932bd4beca7f656457147e8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Creating volume c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:15 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a Jul 05 18:27:15 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:27:15 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:27:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:15 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f 1073741824 Jul 05 18:27:15 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:16 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-08e4ee95-3516-40cb-a2a0-ee98a8733822" returned: 0 in 1.369s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-quobyte-08e4ee95-3516-40cb-a2a0-ee98a8733822" released by "delete_volume" :: held 2.788s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Created reservations ['4d4d7874-0704-4d71-a67b-70733fab763f', '0da869c0-6003-47a2-9572-93318f95a7c5', 'fa46ceec-d647-49f7-a40a-5f2ea63ba293', 'b1b558b0-ff43-42b7-a00c-4dbeddc71acd'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:16 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:27:16 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-671c245c-2921-43fd-9228-ea89e61b1b83 tempest-VolumesActionsTest-803818908 None] Acquiring lock "cinder-789fd172-3be6-4f59-825c-520f5101d170" by "attach_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-671c245c-2921-43fd-9228-ea89e61b1b83 tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170" acquired by "attach_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-671c245c-2921-43fd-9228-ea89e61b1b83 tempest-VolumesActionsTest-803818908 None] Attaching volume 789fd172-3be6-4f59-825c-520f5101d170 to instance feb22263-2fd9-49f6-bf2c-e787dcdda312 at mountpoint /dev/vdb on host None. Jul 05 18:27:17 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f 1073741824" returned: 0 in 1.321s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-671c245c-2921-43fd-9228-ea89e61b1b83 tempest-VolumesActionsTest-803818908 None] Attach volume completed successfully. Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-671c245c-2921-43fd-9228-ea89e61b1b83 tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170" released by "attach_volume" :: held 0.234s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:17 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f Jul 05 18:27:17 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:17 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a" returned: 0 in 1.855s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7528fd0-7bf9-4aa1-a2e4-e6db4cddf9fe]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "cinder-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:17 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d Jul 05 18:27:17 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "cinder-quobyte-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-quobyte-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab295732-cb22-4e8b-a5de-b5d318ec0e85 tempest-VolumesActionsTest-803818908 None] Acquiring lock "cinder-789fd172-3be6-4f59-825c-520f5101d170-detach_volume" by "detach_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bf2447-009b-4ef4-9cc2-5217768e9f2b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab295732-cb22-4e8b-a5de-b5d318ec0e85 tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:18 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ab295732-cb22-4e8b-a5de-b5d318ec0e85 tempest-VolumesActionsTest-803818908 None] Detaching volume 789fd172-3be6-4f59-825c-520f5101d170 from instance feb22263-2fd9-49f6-bf2c-e787dcdda312. Jul 05 18:27:18 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.338s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:27:18 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Deleted volume successfully. Jul 05 18:27:18 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ab295732-cb22-4e8b-a5de-b5d318ec0e85 tempest-VolumesActionsTest-803818908 None] Detach volume completed successfully. Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f12005d-efc7-4ac6-a282-0a832476218b tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-08e4ee95-3516-40cb-a2a0-ee98a8733822-delete_volume" released by "delete_volume" :: held 4.521s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab295732-cb22-4e8b-a5de-b5d318ec0e85 tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170-detach_volume" released by "detach_volume" :: held 0.174s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:18 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 Jul 05 18:27:18 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:18 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f" returned: 0 in 1.303s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] <== create_volume: return (2723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.727s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352687bc-6f41-464e-ad25-7ea661248a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bce889a-50bd-438f-abd5-2ddd718eec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:18 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Volume volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f (c77e7d99-9fff-49d2-aa81-4313c2473c6f): created successfully Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bce889a-50bd-438f-abd5-2ddd718eec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Flow 'volume_create_manager' (ea1f1b92-771c-4797-8b5e-6509c5a8d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:27:18 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-39df84ef-ac7e-4295-b14e-7686ff24fcc1 tempest-VolumesDeleteCascade-1926125956 None] Created volume successfully. Jul 05 18:27:19 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" returned: 0 in 1.665s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:19 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a Jul 05 18:27:19 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:19 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016" returned: 0 in 1.392s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:19 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016 Jul 05 18:27:19 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Creating offline snapshot e00544ea-7f61-499c-8ec8-a8cbc6d73482 of volume c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:27:19 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdf7f69-83d2-4c36-9e0b-574a3948f338]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:19 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f Jul 05 18:27:19 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:20 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a" returned: 0 in 1.302s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:20 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a Jul 05 18:27:20 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:20 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016" returned: 0 in 1.087s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-quobyte-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016" released by "delete_volume" :: held 2.607s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Created reservations ['d73de15b-7300-45df-a4bf-b9fa961f2ea0', '352b0cac-6fe4-4d09-a722-6b273d86ca48', '6fcac871-944e-49fe-ad54-416cba135c03', '75bd8fb2-8476-461f-bea5-fbf4d94c9466'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:20 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:27:20 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:20 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f" returned: 0 in 1.059s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:20 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 1G Jul 05 18:27:20 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:21 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d.21583a45-a8b5-4e60-9711-fbb7a84d749a" returned: 0 in 1.298s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-quobyte-21583a45-a8b5-4e60-9711-fbb7a84d749a" released by "_delete_snapshot" :: held 6.381s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-quobyte-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" released by "delete_snapshot" :: held 6.434s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:21 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Created reservations ['b0f0eaa7-1440-4028-ae57-b17913c5419f', '83591fb6-68c8-4dbf-94a9-33a93cb2350e', '0ad10bae-0325-4b36-bf28-70e60b09439a', '95dafd93-934e-40f8-8e57-9932f2a36b05'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:27:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Delete snapshot completed successfully. Jul 05 18:27:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c8827a8b-d5f8-4496-8151-fcbc4fd8a1a0 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-21583a45-a8b5-4e60-9711-fbb7a84d749a-delete_snapshot" released by "delete_snapshot" :: held 6.674s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:22 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.441s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:22 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:27:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Deleted volume successfully. Jul 05 18:27:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79f621da-9734-4784-9814-fd354600d143 tempest-AttachVolumeNegativeTest-503091028 None] Lock "cinder-6ce20a35-0bf4-4f7d-bf21-15a4f41e7016-delete_volume" released by "delete_volume" :: held 4.394s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:22 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 1G" returned: 0 in 1.676s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:22 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 Jul 05 18:27:22 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Acquiring lock "cinder-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Acquiring lock "cinder-quobyte-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-quobyte-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:23 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[41640485-6043-4bdf-b9c0-53cd288fec52]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:23 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d Jul 05 18:27:23 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:23 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482" returned: 0 in 1.040s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:23 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 is being set with open permissions: ugo+rw Jul 05 18:27:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:23 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 Jul 05 18:27:23 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:24 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" returned: 0 in 1.186s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:24 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482" returned: 0 in 0.999s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:24 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d Jul 05 18:27:24 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:24 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.info Jul 05 18:27:24 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:25 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.info" returned: 0 in 0.913s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:25 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.info is being set with open permissions: ugo+rw Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:25 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" returned: 0 in 0.993s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:25 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.info Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-quobyte-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d" released by "delete_volume" :: held 2.266s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:25 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Created reservations ['13ff2962-de1e-46ce-81cb-896e5130d710', '0b840072-9d7a-454f-aa8a-c1c86fcee80c', '7b987647-7ce5-4033-852f-a7f3a89e83ac', 'e39c5225-16af-4a0b-8d37-18f4e9c9af3c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:25 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:27:25 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:26 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.info" returned: 0 in 1.156s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.020s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:26 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d0f965db-f23f-4ce1-b123-4246b3ccc681 tempest-VolumesDeleteCascade-1926125956 None] Create snapshot completed successfully Jul 05 18:27:26 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.098s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:26 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:27:26 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Deleted volume successfully. Jul 05 18:27:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a6b53a55-0b73-49e5-8d0b-6c2fdee571e8 tempest-SnapshotMetadataTestJSON-934169171 None] Lock "cinder-2ebb7679-ddfc-4276-8ffe-cb9d7eba042d-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Creating offline snapshot 5d2c7925-e9c7-4a04-a287-cbc81286d693 of volume c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:27:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca5996-06dc-4baf-b07b-53673be60943]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:27 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 Jul 05 18:27:27 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:28 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482" returned: 0 in 1.119s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:27:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:28 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 1G Jul 05 18:27:28 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:29 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 1G" returned: 0 in 1.174s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:29 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 Jul 05 18:27:29 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:30 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693" returned: 0 in 0.889s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:30 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 is being set with open permissions: ugo+rw Jul 05 18:27:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:30 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 Jul 05 18:27:30 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:31 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693" returned: 0 in 0.817s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.426s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:31 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feb75a9-8a8d-4199-82aa-cd33ce9d806d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:31 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-14aaf16f-d6b4-4608-9c3e-098e94f800e9 tempest-VolumesDeleteCascade-1926125956 None] Create snapshot completed successfully Jul 05 18:27:31 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 Jul 05 18:27:31 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-c77e7d99-9fff-49d2-aa81-4313c2473c6f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-c77e7d99-9fff-49d2-aa81-4313c2473c6f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Performing cascade delete. {{(pid=86664) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 05 18:27:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-5d2c7925-e9c7-4a04-a287-cbc81286d693-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:32 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170" returned: 0 in 1.310s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-5d2c7925-e9c7-4a04-a287-cbc81286d693-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-c77e7d99-9fff-49d2-aa81-4313c2473c6f" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c66bc78-1f28-48f4-8a61-3110f805bc44]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-c77e7d99-9fff-49d2-aa81-4313c2473c6f" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-5d2c7925-e9c7-4a04-a287-cbc81286d693" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-5d2c7925-e9c7-4a04-a287-cbc81286d693" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Deleting offline snapshot 5d2c7925-e9c7-4a04-a287-cbc81286d693 of volume c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] snapshot_file for this snap is: volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[938241ab-47b8-4713-8507-601b21ab6f38]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:33 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 Jul 05 18:27:33 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:33 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 Jul 05 18:27:33 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:34 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170" returned: 0 in 1.311s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.8642c4d1-fcc1-4173-96d0-83a216235c86x0qiku0e.img {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:34 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.8642c4d1-fcc1-4173-96d0-83a216235c86x0qiku0e.img Jul 05 18:27:34 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:34 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693" returned: 0 in 1.375s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:27:34 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd81224c-4e8a-4dbb-b9f6-2917119e6ed7]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:34 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 Jul 05 18:27:34 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:36 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482" returned: 0 in 2.145s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:27:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:36 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 Jul 05 18:27:36 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:38 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693" returned: 0 in 1.947s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:38 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693 Jul 05 18:27:38 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:40 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.5d2c7925-e9c7-4a04-a287-cbc81286d693" returned: 0 in 1.880s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-5d2c7925-e9c7-4a04-a287-cbc81286d693" released by "_delete_snapshot" :: held 7.563s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-c77e7d99-9fff-49d2-aa81-4313c2473c6f" released by "delete_snapshot" :: held 7.611s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:40 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Created reservations ['db80e844-c3ac-493d-8285-f4c25893ee7d', 'd149fc40-526e-48cc-9817-ca286f2a6524', 'b044c726-4591-40fc-bcd6-39f56946466e', 'ff3c9656-938b-4bbb-8ea3-b8f8735c8ac9'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:27:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Delete snapshot completed successfully. Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-5d2c7925-e9c7-4a04-a287-cbc81286d693-delete_snapshot" released by "delete_snapshot" :: held 8.081s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-e00544ea-7f61-499c-8ec8-a8cbc6d73482-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-e00544ea-7f61-499c-8ec8-a8cbc6d73482-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-c77e7d99-9fff-49d2-aa81-4313c2473c6f" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-c77e7d99-9fff-49d2-aa81-4313c2473c6f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-e00544ea-7f61-499c-8ec8-a8cbc6d73482" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-e00544ea-7f61-499c-8ec8-a8cbc6d73482" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:41 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Deleting offline snapshot e00544ea-7f61-499c-8ec8-a8cbc6d73482 of volume c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] snapshot_file for this snap is: volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.8642c4d1-fcc1-4173-96d0-83a216235c86x0qiku0e.img" returned: 0 in 6.907s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c82d3c0-f744-47fb-a7f2-38115d0a6653]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ad420f-5a0e-48af-bd24-27139f5b9fa8]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:41 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 Jul 05 18:27:41 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:41 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 Jul 05 18:27:41 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:42 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482" returned: 0 in 1.225s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:27:42 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[960e2571-b04c-4e56-9248-e991e29163d6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:42 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170" returned: 0 in 1.361s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:42 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170, size 1024.00 MB, duration 6.91 sec, destination /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.8642c4d1-fcc1-4173-96d0-83a216235c86x0qiku0e.img {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:27:42 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Converted 1024.00 MB image at 148.22 MB/s Jul 05 18:27:42 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] 8642c4d1-fcc1-4173-96d0-83a216235c86 was raw, no need to convert to raw {{(pid=86664) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 05 18:27:42 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f Jul 05 18:27:42 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:43 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f" returned: 0 in 1.151s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:43 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 Jul 05 18:27:43 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:44 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482" returned: 0 in 1.232s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:45 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482 Jul 05 18:27:45 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f.e00544ea-7f61-499c-8ec8-a8cbc6d73482" returned: 0 in 1.419s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:46 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-e00544ea-7f61-499c-8ec8-a8cbc6d73482" released by "_delete_snapshot" :: held 5.302s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-c77e7d99-9fff-49d2-aa81-4313c2473c6f" released by "delete_snapshot" :: held 5.343s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Created reservations ['7f19d4f3-6098-48dd-8d25-04955e6889a5', 'f19da294-8dc3-4155-a2bd-5e109bc2932c', 'a0cce9e7-6dc9-4fca-96ea-2571cb1f412f', '4b387757-3dab-43e0-a01d-b0c34a8a982a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:27:46 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Delete snapshot completed successfully. Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-e00544ea-7f61-499c-8ec8-a8cbc6d73482-delete_snapshot" released by "delete_snapshot" :: held 5.644s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Snapshots deleted, issuing volume delete {{(pid=86664) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-c77e7d99-9fff-49d2-aa81-4313c2473c6f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-c77e7d99-9fff-49d2-aa81-4313c2473c6f" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e160533a-b568-4b52-a034-b1224e7cd52b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:27:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:47 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f Jul 05 18:27:47 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:48 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f" returned: 0 in 1.536s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:48 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f Jul 05 18:27:48 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:49 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c77e7d99-9fff-49d2-aa81-4313c2473c6f" returned: 0 in 1.114s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-c77e7d99-9fff-49d2-aa81-4313c2473c6f" released by "delete_volume" :: held 2.783s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:49 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Created reservations ['7531c9ef-ed7d-4506-b0d8-87fe5df3d5b0', 'cb3fb13c-88b4-4bcb-b68a-3055864a21f3', 'a3a30838-2c27-4a8b-9bb7-656c4b6d4e64', 'b25a6e55-ccbb-41a2-8a92-30bcb95bd4c6'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:27:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:27:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:27:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:27:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:27:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:27:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:27:49 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:27:49 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:27:51 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.383s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:27:51 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Deleted volume successfully. Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2cc71e8-f3ac-4464-8e30-7768727593e5 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-c77e7d99-9fff-49d2-aa81-4313c2473c6f-delete_volume" released by "delete_volume" :: held 18.471s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Flow 'volume_create_manager' (b20a29ea-f6ce-4fd5-b2d5-dd28a6ad038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52203c9-7903-400c-8f48-5d279a355845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52203c9-7903-400c-8f48-5d279a355845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-164518914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f965232a-7e92-486a-a06a-d99ee51aef05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d047da84bcb428dbd8ab8e1f36bedbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:27:52Z,use_quota=True,user_id='062fd9f932bd4beca7f656457147e8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d411ea3-009c-42ac-ac0e-2cb42961e0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d411ea3-009c-42ac-ac0e-2cb42961e0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb53da51-5d23-4cfa-a4c3-bcf289902cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb53da51-5d23-4cfa-a4c3-bcf289902cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f965232a-7e92-486a-a06a-d99ee51aef05', 'volume_name': 'volume-f965232a-7e92-486a-a06a-d99ee51aef05', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e2cd5e-2a0a-48d9-aa68-a0a26c6ddd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e2cd5e-2a0a-48d9-aa68-a0a26c6ddd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0851ed08-c476-47b6-9d32-d2158bf0b2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:27:51 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Volume f965232a-7e92-486a-a06a-d99ee51aef05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f965232a-7e92-486a-a06a-d99ee51aef05', 'volume_size': 1} Jul 05 18:27:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:01 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:INSERT=34,cinder:SELECT=83,cinder:UPDATE=88,cinder:DELETE=7 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:28:01 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=83,cinder:INSERT=25,cinder:UPDATE=94,cinder:DELETE=7 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 40.112s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Uploaded volume to glance image-id: 8642c4d1-fcc1-4173-96d0-83a216235c86. {{(pid=86664) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.916s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-164518914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f965232a-7e92-486a-a06a-d99ee51aef05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d047da84bcb428dbd8ab8e1f36bedbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:27:52Z,use_quota=True,user_id='062fd9f932bd4beca7f656457147e8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Creating volume f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:28:11 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:28:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:11 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 1073741824 Jul 05 18:28:11 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:11 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5f0e33b6-a3f6-4f39-a951-2bb18e5fd2e4 tempest-VolumesActionsTest-803818908 None] Copy volume to image completed successfully. Jul 05 18:28:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:28:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:12 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:28:12 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:12 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 1073741824" returned: 0 in 1.004s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:12 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 Jul 05 18:28:12 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:13 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.941s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:28:13 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05" returned: 0 in 1.129s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0851ed08-c476-47b6-9d32-d2158bf0b2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f965232a-7e92-486a-a06a-d99ee51aef05', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa9b2ab-a620-476e-ad7e-ae6377bc7a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:13 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Volume volume-f965232a-7e92-486a-a06a-d99ee51aef05 (f965232a-7e92-486a-a06a-d99ee51aef05): created successfully Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa9b2ab-a620-476e-ad7e-ae6377bc7a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Flow 'volume_create_manager' (b20a29ea-f6ce-4fd5-b2d5-dd28a6ad038e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:28:14 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6ce12e87-8410-4407-bf75-dd8fc964d859 tempest-VolumesDeleteCascade-1926125956 None] Created volume successfully. Jul 05 18:28:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:14 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a3568f-afd8-46ad-a19f-d95c837ca4d1]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:15 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 Jul 05 18:28:15 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:16 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170" returned: 0 in 1.221s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c5421b-d027-4be8-b073-bfc289495397]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:16 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 Jul 05 18:28:16 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:17 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170" returned: 0 in 0.981s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:17 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img Jul 05 18:28:17 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:23 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img" returned: 0 in 6.559s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:23 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d875406-d4fe-43fe-8c97-8b7ffc5e08fe]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:23 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 Jul 05 18:28:23 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:24 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170" returned: 0 in 1.232s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:24 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:28:24 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Converted 1024.00 MB image at 156.10 MB/s Jul 05 18:28:24 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] bd518d08-3ef2-4f0e-8551-18f96bca0f81 was raw, converting to qcow2 {{(pid=86664) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 05 18:28:24 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[750218d2-4d30-4fe4-b9b5-e443d2488b72]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:25 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img Jul 05 18:28:25 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:25 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:28:25 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img" returned: 0 in 0.892s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:25 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img Jul 05 18:28:25 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:26 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img" returned: 1 in 0.778s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:28:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img /opt/stack/data/cinder/conversion/vol_upload_prookqjo {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:26 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img /opt/stack/data/cinder/conversion/vol_upload_prookqjo Jul 05 18:28:26 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:27 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img /opt/stack/data/cinder/conversion/vol_upload_prookqjo" returned: 0 in 0.810s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:27 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Image conversion details: src /opt/stack/data/cinder/conversion/789fd172-3be6-4f59-825c-520f5101d170.temp_image.bd518d08-3ef2-4f0e-8551-18f96bca0f818pf86yw_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_prookqjo {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:28:27 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 05 18:28:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a260fd-e848-492b-9d04-99e4d0174dac]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_prookqjo {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:27 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_prookqjo Jul 05 18:28:27 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:28 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_prookqjo" returned: 0 in 0.793s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.788s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Uploaded volume to glance image-id: bd518d08-3ef2-4f0e-8551-18f96bca0f81. {{(pid=86664) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 05 18:28:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.046s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Creating offline snapshot 1961a181-16b1-4a74-a802-169906aad894 of volume f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:28:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fc92985f-e87d-4481-a950-23d7d11781e6 tempest-VolumesActionsTest-803818908 None] Copy volume to image completed successfully. Jul 05 18:28:30 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22979ab-7476-4cd6-be57-4a85a06c310c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:30 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 Jul 05 18:28:30 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Acquiring lock "cinder-789fd172-3be6-4f59-825c-520f5101d170-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:31 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05" returned: 0 in 1.199s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:31 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 1G Jul 05 18:28:31 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Acquiring lock "cinder-quobyte-789fd172-3be6-4f59-825c-520f5101d170" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Lock "cinder-quobyte-789fd172-3be6-4f59-825c-520f5101d170" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:32 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[582d7bb3-3ed3-43c6-a304-b77c512171fc]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:32 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 Jul 05 18:28:32 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:33 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 1G" returned: 0 in 1.387s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f965232a-7e92-486a-a06a-d99ee51aef05 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:33 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f965232a-7e92-486a-a06a-d99ee51aef05 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 Jul 05 18:28:33 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:33 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170" returned: 0 in 1.339s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:33 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170 Jul 05 18:28:33 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:34 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-789fd172-3be6-4f59-825c-520f5101d170" returned: 0 in 0.967s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Lock "cinder-quobyte-789fd172-3be6-4f59-825c-520f5101d170" released by "delete_volume" :: held 2.420s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:34 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Created reservations ['53adfb66-f4c3-4ff2-b587-50f6ae4c1ee7', 'bc3756ab-f39a-4259-91c8-07f3caed7421', '8593747c-2826-4a8b-8dd0-596dd90a1a53', '08aec6f7-76de-48ee-8e00-ebfae4a74ed2'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:28:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:34 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:28:34 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:35 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f965232a-7e92-486a-a06a-d99ee51aef05 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894" returned: 0 in 1.781s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:35 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 is being set with open permissions: ugo+rw Jul 05 18:28:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:35 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 Jul 05 18:28:35 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:35 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.105s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:35 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:28:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Deleted volume successfully. Jul 05 18:28:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3f883b4-57aa-40d4-899c-8ceb796d0622 tempest-VolumesActionsTest-803818908 None] Lock "cinder-789fd172-3be6-4f59-825c-520f5101d170-delete_volume" released by "delete_volume" :: held 4.054s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:36 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894" returned: 0 in 1.450s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:36 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.info Jul 05 18:28:36 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Flow 'volume_create_manager' (2d7c659e-0599-433b-9ee4-951fa0385159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b21521-c9cb-4364-800b-14dee6d94a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:37 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.info" returned: 0 in 1.303s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:37 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.info is being set with open permissions: ugo+rw Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b21521-c9cb-4364-800b-14dee6d94a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1906210814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9d5010-4153-4610-b965-fe263bf620cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9351a7e96f98488d9778cc3925dce5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:28:38Z,use_quota=True,user_id='dafccba0329f4a06b6983adcb3288f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71dc4ac2-b7fb-4bda-a97a-4ac74de55bab),volume_type_id=71dc4ac2-b7fb-4bda-a97a-4ac74de55bab)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:37 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.info Jul 05 18:28:37 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936d8915-6327-4196-8233-4c2f8cf1f463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936d8915-6327-4196-8233-4c2f8cf1f463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6087304c-d953-4fb2-9b96-560a168fe6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6087304c-d953-4fb2-9b96-560a168fe6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9d5010-4153-4610-b965-fe263bf620cb', 'volume_name': 'volume-cd9d5010-4153-4610-b965-fe263bf620cb', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf30ea85-266c-40b7-b570-3cddaa973e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf30ea85-266c-40b7-b570-3cddaa973e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81193d5-f943-49d2-905d-fdf2177f3919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:38 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Volume cd9d5010-4153-4610-b965-fe263bf620cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9d5010-4153-4610-b965-fe263bf620cb', 'volume_size': 1} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:38 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.info" returned: 0 in 0.807s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.086s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1906210814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9d5010-4153-4610-b965-fe263bf620cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9351a7e96f98488d9778cc3925dce5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:28:38Z,use_quota=True,user_id='dafccba0329f4a06b6983adcb3288f22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71dc4ac2-b7fb-4bda-a97a-4ac74de55bab),volume_type_id=71dc4ac2-b7fb-4bda-a97a-4ac74de55bab)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Creating volume cd9d5010-4153-4610-b965-fe263bf620cb {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:28:38 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:28:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:38 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb 1073741824 Jul 05 18:28:38 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:38 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4b09e88a-e042-41cc-8354-40a3084ffe65 tempest-VolumesDeleteCascade-1926125956 None] Create snapshot completed successfully Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Flow 'volume_create_manager' (a970496f-a28b-4345-87bb-4f82676a8320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8429095d-7955-4f19-be26-0993ede8a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8429095d-7955-4f19-be26-0993ede8a358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1941059907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb60568-5943-4fb7-8f02-ec04234f3d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d047da84bcb428dbd8ab8e1f36bedbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1961a181-16b1-4a74-a802-169906aad894,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:28:40Z,use_quota=True,user_id='062fd9f932bd4beca7f656457147e8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99da7f1d-01f9-491c-aa97-03c5afb7c202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99da7f1d-01f9-491c-aa97-03c5afb7c202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db645de0-3182-4085-816c-67d5d24c299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db645de0-3182-4085-816c-67d5d24c299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7eb60568-5943-4fb7-8f02-ec04234f3d91', 'volume_name': 'volume-7eb60568-5943-4fb7-8f02-ec04234f3d91', 'volume_size': 1, 'snapshot_id': '1961a181-16b1-4a74-a802-169906aad894'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7149ee6c-69e3-4012-b3b9-e4113c8fc4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7149ee6c-69e3-4012-b3b9-e4113c8fc4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3a6e48-ee3a-49df-9640-cbdfb62f2d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:40 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Volume 7eb60568-5943-4fb7-8f02-ec04234f3d91: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7eb60568-5943-4fb7-8f02-ec04234f3d91', 'volume_size': 1, 'snapshot_id': '1961a181-16b1-4a74-a802-169906aad894'} Jul 05 18:28:40 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb 1073741824" returned: 0 in 1.432s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:40 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb Jul 05 18:28:40 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:41 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb" returned: 0 in 0.808s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.300s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.858s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-1961a181-16b1-4a74-a802-169906aad894-7eb60568-5943-4fb7-8f02-ec04234f3d91" by "_create_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a81193d5-f943-49d2-905d-fdf2177f3919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9d5010-4153-4610-b965-fe263bf620cb', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2bd424-0bf9-4a9e-9063-64cef3296a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-1961a181-16b1-4a74-a802-169906aad894-7eb60568-5943-4fb7-8f02-ec04234f3d91" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Creating volume 7eb60568-5943-4fb7-8f02-ec04234f3d91 from snapshot 1961a181-16b1-4a74-a802-169906aad894 {{(pid=86664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-7eb60568-5943-4fb7-8f02-ec04234f3d91" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:41 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Volume volume-cd9d5010-4153-4610-b965-fe263bf620cb (cd9d5010-4153-4610-b965-fe263bf620cb): created successfully Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2bd424-0bf9-4a9e-9063-64cef3296a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Flow 'volume_create_manager' (2d7c659e-0599-433b-9ee4-951fa0385159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-7eb60568-5943-4fb7-8f02-ec04234f3d91" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] snapshot: 1961a181-16b1-4a74-a802-169906aad894, volume: 7eb60568-5943-4fb7-8f02-ec04234f3d91, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:28:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e47134a5-61c6-4617-a705-5b8a29a1dd2a tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Created volume successfully. Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c46ad2-6f63-484d-92ec-02c9261e8e0a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:41 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 Jul 05 18:28:41 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:42 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894" returned: 0 in 1.002s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f965232a-7e92-486a-a06a-d99ee51aef05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5276dc-420e-4a56-b899-b5f8812d71bb]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:42 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 Jul 05 18:28:42 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-603ebc4b-2aed-4d46-9aac-c2626cb16428 tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-603ebc4b-2aed-4d46-9aac-c2626cb16428 tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-603ebc4b-2aed-4d46-9aac-c2626cb16428 tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-603ebc4b-2aed-4d46-9aac-c2626cb16428 tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-603ebc4b-2aed-4d46-9aac-c2626cb16428 tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-603ebc4b-2aed-4d46-9aac-c2626cb16428 tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:42 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:28:42 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:43 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05" returned: 0 in 1.303s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:43 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:28:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:43 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 Jul 05 18:28:43 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:44 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-603ebc4b-2aed-4d46-9aac-c2626cb16428 tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.120s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:44 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-603ebc4b-2aed-4d46-9aac-c2626cb16428 tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:28:44 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-603ebc4b-2aed-4d46-9aac-c2626cb16428 tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Retype volume completed successfully. Jul 05 18:28:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Acquiring lock "cinder-cd9d5010-4153-4610-b965-fe263bf620cb-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "cinder-cd9d5010-4153-4610-b965-fe263bf620cb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Acquiring lock "cinder-quobyte-cd9d5010-4153-4610-b965-fe263bf620cb" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "cinder-quobyte-cd9d5010-4153-4610-b965-fe263bf620cb" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:44 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9b91f7-1eb7-4ef9-a03e-1cb1267b66fc]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:44 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb Jul 05 18:28:44 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:46 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb" returned: 0 in 1.532s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:46 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb Jul 05 18:28:46 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:48 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cd9d5010-4153-4610-b965-fe263bf620cb" returned: 0 in 2.080s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "cinder-quobyte-cd9d5010-4153-4610-b965-fe263bf620cb" released by "delete_volume" :: held 3.691s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:48 devstack cinder-volume[86664]: WARNING cinder.quota [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:28:48 devstack cinder-volume[86664]: WARNING cinder.quota [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:28:48 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Created reservations ['c5a8a1cf-e7ae-45d5-979e-dde069e10a7b', '971ac8a2-0891-41d9-8f80-5125b356b7fe', 'db615c28-21b4-48cc-9bf8-e289a3fba500', 'a07f25bf-d3aa-4f3e-8733-d040ad6dd9ee'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:28:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:48 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:28:48 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Flow 'volume_create_manager' (a050e83b-9c95-4b71-8450-d66665382194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4f05b7-430c-4232-a137-fcac3b3ab3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:49 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.409s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:28:49 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Deleted volume successfully. Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4f05b7-430c-4232-a137-fcac3b3ab3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-830914120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e3082d-cb8b-44d2-a9ce-99e607b6b1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456a7f36358640f79bf32f14731decb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:28:50Z,use_quota=True,user_id='c6eea7e91b0d4b5e9a6a549ca43f11b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0aef488-6564-4434-a1df-0e783ffc2629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0aef488-6564-4434-a1df-0e783ffc2629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b5005f-0e1e-4d86-ba5c-e5a2ef6a4d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.image.glance [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Creating Keystone auth plugin from conf {{(pid=86664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cf5f5fd6-5b5a-4892-9e93-c3eeed5c54de tempest-VolumeRetypeWithoutMigrationTest-1338074076 None] Lock "cinder-cd9d5010-4153-4610-b965-fe263bf620cb-delete_volume" released by "delete_volume" :: held 5.646s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:49 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91" returned: 0 in 6.343s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a354221-a45d-4841-bfcd-05e48a43c96e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:50 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 Jul 05 18:28:50 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b5005f-0e1e-4d86-ba5c-e5a2ef6a4d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92e3082d-cb8b-44d2-a9ce-99e607b6b1c8', 'volume_name': 'volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cbc251-18c0-4d03-a8ba-11c24e308660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cbc251-18c0-4d03-a8ba-11c24e308660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4047e261-f238-4ae7-836a-4c3f9bda81a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:50 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Volume 92e3082d-cb8b-44d2-a9ce-99e607b6b1c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 18:28:50 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Trying to clone 92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 from image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]). {{(pid=86664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 18:28:50 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 18:28:50 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Image download 20.69 MB at 20.69 MB/s Jul 05 18:28:51 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1410e9f2-8bfe-4574-8911-21086de46778]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:51 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD Jul 05 18:28:51 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05" returned: 0 in 1.271s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:51 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:51 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:28:51 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Converted 1024.00 MB image at 161.36 MB/s Jul 05 18:28:51 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 is being set with open permissions: ugo+rw Jul 05 18:28:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:51 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 Jul 05 18:28:51 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:52 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91" returned: 0 in 0.839s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-7eb60568-5943-4fb7-8f02-ec04234f3d91" released by "_copy_volume_from_snapshot" :: held 10.981s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-1961a181-16b1-4a74-a802-169906aad894-7eb60568-5943-4fb7-8f02-ec04234f3d91" released by "_create_volume_from_snapshot" :: held 11.052s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.091s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3a6e48-ee3a-49df-9640-cbdfb62f2d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb60568-5943-4fb7-8f02-ec04234f3d91', 'volume_size': 1, 'snapshot_id': '1961a181-16b1-4a74-a802-169906aad894'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:52 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23778a35-32ff-4df2-9e66-254eb167d4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD" returned: 0 in 1.177s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Temporary image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 is fetched for user c6eea7e91b0d4b5e9a6a549ca43f11b0. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 18:28:52 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Volume volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 (7eb60568-5943-4fb7-8f02-ec04234f3d91): created successfully Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23778a35-32ff-4df2-9e66-254eb167d4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Flow 'volume_create_manager' (a970496f-a28b-4345-87bb-4f82676a8320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:28:52 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c7163914-d551-4820-aeda-24d647943f14 tempest-VolumesDeleteCascade-1926125956 None] Created volume successfully. Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f25f73-bb83-46ed-8fa6-1dfd1049f5ed]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:52 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD Jul 05 18:28:52 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-f965232a-7e92-486a-a06a-d99ee51aef05-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-f965232a-7e92-486a-a06a-d99ee51aef05-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Performing cascade delete. {{(pid=86664) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-1961a181-16b1-4a74-a802-169906aad894-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-1961a181-16b1-4a74-a802-169906aad894-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-f965232a-7e92-486a-a06a-d99ee51aef05" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-f965232a-7e92-486a-a06a-d99ee51aef05" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-1961a181-16b1-4a74-a802-169906aad894" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-1961a181-16b1-4a74-a802-169906aad894" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Deleting offline snapshot 1961a181-16b1-4a74-a802-169906aad894 of volume f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] snapshot_file for this snap is: volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fefb52-655d-4551-8eb3-241e1b4a6ca6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:53 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 Jul 05 18:28:53 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:53 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD" returned: 0 in 1.099s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-830914120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e3082d-cb8b-44d2-a9ce-99e607b6b1c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456a7f36358640f79bf32f14731decb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:28:50Z,use_quota=True,user_id='c6eea7e91b0d4b5e9a6a549ca43f11b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Creating volume 92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:28:53 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:28:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:53 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 1073741824 Jul 05 18:28:53 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:54 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894" returned: 0 in 1.069s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f965232a-7e92-486a-a06a-d99ee51aef05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:28:54 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0420cba-0536-4c72-9431-9c1a6563d051]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:54 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 Jul 05 18:28:54 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:54 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 1073741824" returned: 0 in 1.093s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:54 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 Jul 05 18:28:54 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:55 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05" returned: 0 in 0.942s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:55 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 Jul 05 18:28:55 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:55 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" returned: 0 in 0.806s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:28:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:55 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Attempting download of 8ef91c9d-cbe2-449c-b464-74cfa5f50992 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}])) to volume 92e3082d-cb8b-44d2-a9ce-99e607b6b1c8. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 18:28:55 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c1bc0c-ff4b-490c-b3be-c0b9271d08e9]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ybrj61aq {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:55 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ybrj61aq Jul 05 18:28:55 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:56 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894" returned: 0 in 0.952s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:56 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894 Jul 05 18:28:56 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:56 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ybrj61aq" returned: 0 in 0.927s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ybrj61aq {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:56 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ybrj61aq Jul 05 18:28:56 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:56 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05.1961a181-16b1-4a74-a802-169906aad894" returned: 0 in 0.867s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-1961a181-16b1-4a74-a802-169906aad894" released by "_delete_snapshot" :: held 3.999s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-f965232a-7e92-486a-a06a-d99ee51aef05" released by "delete_snapshot" :: held 4.036s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Created reservations ['e11a43b7-7e11-4079-9321-e329237eaeed', 'aed67fa0-fa67-4bb1-b261-481d990906e2', '4bf1794c-3fa6-4301-bb48-15483827fbb3', 'd4552e53-a171-4c59-b68d-79ea5136317c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:28:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Delete snapshot completed successfully. Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-1961a181-16b1-4a74-a802-169906aad894-delete_snapshot" released by "delete_snapshot" :: held 4.314s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Snapshots deleted, issuing volume delete {{(pid=86664) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-f965232a-7e92-486a-a06a-d99ee51aef05" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-f965232a-7e92-486a-a06a-d99ee51aef05" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e6c3b7-d8b5-4cd5-8c35-c66c92f076b3]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:57 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ybrj61aq" returned: 1 in 0.946s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ybrj61aq' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97bf40c-b0b2-470b-b32d-dca16d9b0d86]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:28:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:57 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 Jul 05 18:28:57 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:57 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD Jul 05 18:28:57 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Flow 'volume_create_manager' (bfa47a8c-0d15-4481-bfc4-0ad97bfad606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2e7b39-1e2c-47dd-99c2-8057a3df4745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2e7b39-1e2c-47dd-99c2-8057a3df4745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-223627343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52092d1d-f4f3-4c24-aa5d-c694ddaed593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daab9f8df9b344c6a552a15c175c7dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:28:58Z,use_quota=True,user_id='ce153f8eb24242bf83689cfb9efd6080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3529cb4-62f9-4bf3-a941-118eee1ab45e),volume_type_id=c3529cb4-62f9-4bf3-a941-118eee1ab45e)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5323a7-2acc-4a85-9184-d3b3d3254a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5323a7-2acc-4a85-9184-d3b3d3254a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2b7134-a570-42fd-bc99-807cba0143bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2b7134-a570-42fd-bc99-807cba0143bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52092d1d-f4f3-4c24-aa5d-c694ddaed593', 'volume_name': 'volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30682350-47aa-46b1-91e1-844e1b36beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30682350-47aa-46b1-91e1-844e1b36beb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbae76a-2e09-4b19-ad3c-9922a82714e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Volume 52092d1d-f4f3-4c24-aa5d-c694ddaed593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593', 'volume_size': 1} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-223627343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52092d1d-f4f3-4c24-aa5d-c694ddaed593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daab9f8df9b344c6a552a15c175c7dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:28:58Z,use_quota=True,user_id='ce153f8eb24242bf83689cfb9efd6080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3529cb4-62f9-4bf3-a941-118eee1ab45e),volume_type_id=c3529cb4-62f9-4bf3-a941-118eee1ab45e)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Creating volume 52092d1d-f4f3-4c24-aa5d-c694ddaed593 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:28:58 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:58 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 1073741824 Jul 05 18:28:58 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:58 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD" returned: 0 in 0.950s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] 8ef91c9d-cbe2-449c-b464-74cfa5f50992 was qcow2, converting to raw {{(pid=86664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:58 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 Jul 05 18:28:58 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:58 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05" returned: 0 in 1.289s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:58 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05 Jul 05 18:28:58 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Flow 'volume_create_manager' (b3a4213e-1eb6-40a9-85fa-3baebcebc9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565d5265-c1d8-44db-99d6-83ff21212b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565d5265-c1d8-44db-99d6-83ff21212b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-606438340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f64a852-7f4f-4ca7-829a-0fcf51ed9c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1be1d347394a10af48de588f0d99b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:28:59Z,use_quota=True,user_id='4f8dd6c5d0594023a35d69453ac47d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ade88f-4e90-4d90-bc09-91947344bcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ade88f-4e90-4d90-bc09-91947344bcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0752b1f9-4831-48d4-8f8c-3e262f4b3f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0752b1f9-4831-48d4-8f8c-3e262f4b3f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f64a852-7f4f-4ca7-829a-0fcf51ed9c44', 'volume_name': 'volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e501f1-eafd-4df5-9666-ac373fef6233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e501f1-eafd-4df5-9666-ac373fef6233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daff926-563c-450e-a4ca-7d44998273bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:28:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Volume 5f64a852-7f4f-4ca7-829a-0fcf51ed9c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44', 'volume_size': 1} Jul 05 18:28:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:59 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 1073741824" returned: 0 in 1.036s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:59 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 Jul 05 18:28:59 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:28:59 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f965232a-7e92-486a-a06a-d99ee51aef05" returned: 0 in 0.839s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-f965232a-7e92-486a-a06a-d99ee51aef05" released by "delete_volume" :: held 2.224s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Created reservations ['5e2933ba-804c-4a62-9233-0cd34804f0a6', '1c785dd3-fe8c-48ba-986f-829ec4960cf7', '1558bd71-8256-499f-b837-ff3cb74bbceb', 'b51e7ee0-18fb-4c0c-84f0-f2a4f6572e8a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:28:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:28:59 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:28:59 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:00 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593" returned: 0 in 0.870s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.287s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-606438340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f64a852-7f4f-4ca7-829a-0fcf51ed9c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1be1d347394a10af48de588f0d99b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:28:59Z,use_quota=True,user_id='4f8dd6c5d0594023a35d69453ac47d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Creating volume 5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:00 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbae76a-2e09-4b19-ad3c-9922a82714e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:00 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 1073741824 Jul 05 18:29:00 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fc3e38-2721-4ffe-8060-a6885b2f496f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:00 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Volume volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 (52092d1d-f4f3-4c24-aa5d-c694ddaed593): created successfully Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fc3e38-2721-4ffe-8060-a6885b2f496f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Flow 'volume_create_manager' (bfa47a8c-0d15-4481-bfc4-0ad97bfad606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:00 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0a884183-8e2d-4b52-a4e5-94682433d888 tempest-VolumeTypesAccessTest-176224803 None] Created volume successfully. Jul 05 18:29:00 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.736s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:00 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Deleted volume successfully. Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3d1085fa-cab6-4592-a6a8-41381c25be55 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-f965232a-7e92-486a-a06a-d99ee51aef05-delete_volume" released by "delete_volume" :: held 7.603s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:00 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" returned: 0 in 2.280s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_3b82h40tdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:29:00 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Converted 112.00 MB image at 49.11 MB/s Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:00 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 1G Jul 05 18:29:00 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-7eb60568-5943-4fb7-8f02-ec04234f3d91-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-7eb60568-5943-4fb7-8f02-ec04234f3d91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "cinder-quobyte-7eb60568-5943-4fb7-8f02-ec04234f3d91" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-7eb60568-5943-4fb7-8f02-ec04234f3d91" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae61aff-a6d1-4077-9f9c-b5da4b19cef9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:01 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 Jul 05 18:29:01 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:01 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 1073741824" returned: 0 in 1.087s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:01 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 Jul 05 18:29:01 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Acquiring lock "cinder-52092d1d-f4f3-4c24-aa5d-c694ddaed593-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Lock "cinder-52092d1d-f4f3-4c24-aa5d-c694ddaed593-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Acquiring lock "cinder-quobyte-52092d1d-f4f3-4c24-aa5d-c694ddaed593" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Lock "cinder-quobyte-52092d1d-f4f3-4c24-aa5d-c694ddaed593" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80af411-40a3-4fa7-8cfc-79ac33621aab]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:01 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 Jul 05 18:29:01 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:01 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 1G" returned: 0 in 0.942s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[827f4526-08c7-4ca5-a758-eb6a0c6fc22c]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:01 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 Jul 05 18:29:01 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:01 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91" returned: 0 in 0.987s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:01 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91 Jul 05 18:29:01 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:02 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44" returned: 0 in 0.817s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=52,cinder:SELECT=49,cinder:DELETE=4,cinder:INSERT=15 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daff926-563c-450e-a4ca-7d44998273bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8989794-31e4-43c4-ab68-1933ec10373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:02 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Volume volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 (5f64a852-7f4f-4ca7-829a-0fcf51ed9c44): created successfully Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8989794-31e4-43c4-ab68-1933ec10373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Flow 'volume_create_manager' (b3a4213e-1eb6-40a9-85fa-3baebcebc9a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2a622663-e0d4-4e40-a32d-913ca4d7779f tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Created volume successfully. Jul 05 18:29:02 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593" returned: 0 in 0.904s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:02 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593 Jul 05 18:29:02 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:02 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" returned: 0 in 0.905s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:02 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 Jul 05 18:29:02 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:02 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7eb60568-5943-4fb7-8f02-ec04234f3d91" returned: 0 in 0.782s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-quobyte-7eb60568-5943-4fb7-8f02-ec04234f3d91" released by "delete_volume" :: held 1.815s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Created reservations ['b103b643-2714-423c-a5e9-6da3626b9ee9', 'bd186d1f-3ce6-4da7-92e9-efe1817567c2', '1dce5870-9f93-4de8-a48b-3f90cfbc7e09', 'a2c693a7-9102-403d-9a67-429881b11a93'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:02 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:02 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:03 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-52092d1d-f4f3-4c24-aa5d-c694ddaed593" returned: 0 in 0.805s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Lock "cinder-quobyte-52092d1d-f4f3-4c24-aa5d-c694ddaed593" released by "delete_volume" :: held 1.780s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:03 devstack cinder-volume[86664]: WARNING cinder.quota [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-326380378 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-326380378, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:29:03 devstack cinder-volume[86664]: WARNING cinder.quota [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-326380378 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-326380378, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Created reservations ['ef2db801-8518-4630-b3a3-adfc6e6045ee', '34e382de-e8b0-493f-bc59-e36e21fa4c9f', 'aa099e2a-6c98-4bbb-a552-01d15441d453', '880a6730-5202-49e0-8252-bf8646474608'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:03 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:03 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:03 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" returned: 1 in 1.074s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Downloaded image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}])) to volume 92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 successfully. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Temporary image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 for user c6eea7e91b0d4b5e9a6a549ca43f11b0 is deleted. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Marking volume 92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 as bootable. {{(pid=86664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Copying metadata from image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 to 92e3082d-cb8b-44d2-a9ce-99e607b6b1c8. {{(pid=86664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Creating volume glance metadata for volume 92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 backed by image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4047e261-f238-4ae7-836a-4c3f9bda81a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b035c871-398f-4514-9636-8e5fda09e540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:03 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Volume volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 (92e3082d-cb8b-44d2-a9ce-99e607b6b1c8): created successfully Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b035c871-398f-4514-9636-8e5fda09e540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Flow 'volume_create_manager' (a050e83b-9c95-4b71-8450-d66665382194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e5a8fd75-e8c7-495c-bd69-bc67da95a795 tempest-VolumesExtendTest-459198428 None] Created volume successfully. Jul 05 18:29:04 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.209s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:04 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Deleted volume successfully. Jul 05 18:29:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21b0687-2da8-45c1-a3f2-0cabdc6d0a03 tempest-VolumesDeleteCascade-1926125956 None] Lock "cinder-7eb60568-5943-4fb7-8f02-ec04234f3d91-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:04 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.016s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:04 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Deleted volume successfully. Jul 05 18:29:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f6aa6f4-8646-4879-a357-5d3132f9077d tempest-VolumeTypesAccessTest-176224803 None] Lock "cinder-52092d1d-f4f3-4c24-aa5d-c694ddaed593-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:05 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f34811-9883-4233-aaf2-7c6f06013208]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:05 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 Jul 05 18:29:05 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:06 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" returned: 0 in 1.042s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:06 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 Jul 05 18:29:06 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-add88193-d71b-4854-b0fe-2332749a375b req-dd6ddb30-eaac-4051-a877-76f3947fd0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:07 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" returned: 1 in 1.011s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:29:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 2G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 2G" returned: 0 in 0.087s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.203s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-add88193-d71b-4854-b0fe-2332749a375b req-dd6ddb30-eaac-4051-a877-76f3947fd0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.900s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:07 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7042109d-9853-4ab5-b46b-a3b31f518482]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-add88193-d71b-4854-b0fe-2332749a375b req-dd6ddb30-eaac-4051-a877-76f3947fd0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c4ba789d-d950-4c5c-ac03-482b7d28822d tempest-VolumesExtendTest-459198428 None] Extend volume completed successfully. Jul 05 18:29:07 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 Jul 05 18:29:07 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:08 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-add88193-d71b-4854-b0fe-2332749a375b req-dd6ddb30-eaac-4051-a877-76f3947fd0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44" returned: 0 in 1.041s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-add88193-d71b-4854-b0fe-2332749a375b req-dd6ddb30-eaac-4051-a877-76f3947fd0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.084s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-add88193-d71b-4854-b0fe-2332749a375b req-dd6ddb30-eaac-4051-a877-76f3947fd0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b007e948-371e-4d49-a573-dd683210ad4c', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:29:08 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-add88193-d71b-4854-b0fe-2332749a375b req-dd6ddb30-eaac-4051-a877-76f3947fd0d4 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] attachment_update completed successfully. Jul 05 18:29:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Acquiring lock "cinder-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Lock "cinder-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Acquiring lock "cinder-quobyte-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Lock "cinder-quobyte-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" acquired by "delete_volume" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[81643256-bfec-458c-bbe1-8c67f677ff24]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:09 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 Jul 05 18:29:09 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:10 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" returned: 0 in 1.222s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Flow 'volume_create_manager' (67a62c2d-ccd0-407b-a634-d87a76c8f9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecedf5a-30c6-4580-ba35-baa00791d92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ecedf5a-30c6-4580-ba35-baa00791d92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1818990729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a99eb2-c272-48bb-acf4-2f59902e6c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67abfcb18c614dbabe0a50759d96a20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:10Z,use_quota=True,user_id='60d32ce760804c5cb6b9efc54fd9fe6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c59a92e-2102-449b-a70b-c8ee49188184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c59a92e-2102-449b-a70b-c8ee49188184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:10 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 Jul 05 18:29:10 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7681a0ed-154a-4d37-8ab1-7883b9421301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7681a0ed-154a-4d37-8ab1-7883b9421301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a99eb2-c272-48bb-acf4-2f59902e6c31', 'volume_name': 'volume-31a99eb2-c272-48bb-acf4-2f59902e6c31', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60d45e9-e0de-41d1-9885-44c16c4e3abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60d45e9-e0de-41d1-9885-44c16c4e3abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba86d7c-1258-495f-80f7-035158737af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:10 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Volume 31a99eb2-c272-48bb-acf4-2f59902e6c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a99eb2-c272-48bb-acf4-2f59902e6c31', 'volume_size': 1} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1818990729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a99eb2-c272-48bb-acf4-2f59902e6c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67abfcb18c614dbabe0a50759d96a20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:10Z,use_quota=True,user_id='60d32ce760804c5cb6b9efc54fd9fe6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Creating volume 31a99eb2-c272-48bb-acf4-2f59902e6c31 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:10 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:10 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 1073741824 Jul 05 18:29:10 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:11 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" returned: 1 in 0.963s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:29:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:11 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8 Jul 05 18:29:11 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:11 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 1073741824" returned: 0 in 1.129s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:11 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 Jul 05 18:29:11 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:11 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" returned: 0 in 0.758s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:11 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Lock "cinder-quobyte-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8" released by "delete_volume" :: held 3.064s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Created reservations ['0abdb025-4b90-4c81-adb3-5378181e413a', '77226639-987d-40a0-b9ef-8f76d4c23364', '34abceea-89ac-4eff-b356-a3036869ee08', 'f0bc5c47-b1a9-414e-8783-306f2b58b16b'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:12 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:12 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:12 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:12 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31" returned: 0 in 1.006s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.215s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba86d7c-1258-495f-80f7-035158737af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a99eb2-c272-48bb-acf4-2f59902e6c31', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efcbb5c-2772-432f-abef-ef9ca16244ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:12 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:12 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Volume volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 (31a99eb2-c272-48bb-acf4-2f59902e6c31): created successfully Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efcbb5c-2772-432f-abef-ef9ca16244ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Flow 'volume_create_manager' (67a62c2d-ccd0-407b-a634-d87a76c8f9af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:12 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-74c5089e-3d05-4076-811d-f709d389e6c7 tempest-VolumesTransfersV357Test-1790625202 None] Created volume successfully. Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Flow 'volume_create_manager' (b187d528-bd2c-4d20-85b3-a6362e9fa281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce5aba0-9dbc-4e0c-a4c8-0562f2615372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ce5aba0-9dbc-4e0c-a4c8-0562f2615372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-709080634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b21f6-fb57-418d-8f55-bab4b1749718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c6269919804961b409851e6bf7b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:13Z,use_quota=True,user_id='7e86c31368864667b2ac307a5341c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bd8ed1-3b8f-4639-9ed8-2ef4211b187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bd8ed1-3b8f-4639-9ed8-2ef4211b187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbecf62-4d32-4108-924e-9137d33c74af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbecf62-4d32-4108-924e-9137d33c74af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0b21f6-fb57-418d-8f55-bab4b1749718', 'volume_name': 'volume-6b0b21f6-fb57-418d-8f55-bab4b1749718', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e4aeea-4d49-4785-be77-76f17d4f287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e4aeea-4d49-4785-be77-76f17d4f287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b1f1f8-2c0d-4f28-a24f-0541395d9778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:12 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Volume 6b0b21f6-fb57-418d-8f55-bab4b1749718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0b21f6-fb57-418d-8f55-bab4b1749718', 'volume_size': 1} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-709080634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b21f6-fb57-418d-8f55-bab4b1749718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69c6269919804961b409851e6bf7b2ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:13Z,use_quota=True,user_id='7e86c31368864667b2ac307a5341c2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Creating volume 6b0b21f6-fb57-418d-8f55-bab4b1749718 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:12 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:13 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 1073741824 Jul 05 18:29:13 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:13 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.152s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Deleted volume successfully. Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-60b392c9-9068-48fb-8c8d-b41287220735 tempest-VolumesExtendTest-459198428 None] Lock "cinder-92e3082d-cb8b-44d2-a9ce-99e607b6b1c8-delete_volume" released by "delete_volume" :: held 4.551s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Flow 'volume_create_manager' (ea9306c5-af33-4418-9945-2803c64829a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336c186b-1287-44a2-8fe5-2d709317f556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:13 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.435s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336c186b-1287-44a2-8fe5-2d709317f556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-377240131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60d8d81-2206-4e59-8ac2-efc88b66f15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456a7f36358640f79bf32f14731decb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:13Z,use_quota=True,user_id='c6eea7e91b0d4b5e9a6a549ca43f11b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b006d23-65f6-4b07-8702-0c2e5fbe2af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b006d23-65f6-4b07-8702-0c2e5fbe2af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfb6ed1-9a90-4849-a915-f3307a7a7af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfb6ed1-9a90-4849-a915-f3307a7a7af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f60d8d81-2206-4e59-8ac2-efc88b66f15c', 'volume_name': 'volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049f4373-bd1c-4511-ab40-e3c7e52adfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049f4373-bd1c-4511-ab40-e3c7e52adfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c58e6b5-5ee1-4a2c-970b-b934934a39b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:13 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Volume f60d8d81-2206-4e59-8ac2-efc88b66f15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c', 'volume_size': 1} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:29:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:29:14 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 1073741824" returned: 0 in 1.093s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:14 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 Jul 05 18:29:14 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:14 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-811218e2-868d-439d-a930-bd038a2e645c tempest-VolumesTransfersV357Test-1363462969 None] Transfer volume completed successfully. Jul 05 18:29:14 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718" returned: 0 in 0.720s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-377240131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60d8d81-2206-4e59-8ac2-efc88b66f15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456a7f36358640f79bf32f14731decb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:13Z,use_quota=True,user_id='c6eea7e91b0d4b5e9a6a549ca43f11b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Creating volume f60d8d81-2206-4e59-8ac2-efc88b66f15c {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:14 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b1f1f8-2c0d-4f28-a24f-0541395d9778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0b21f6-fb57-418d-8f55-bab4b1749718', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:14 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c 1073741824 Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf43d555-c6f0-49ef-9db7-302077b44a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:14 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:14 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Volume volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 (6b0b21f6-fb57-418d-8f55-bab4b1749718): created successfully Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf43d555-c6f0-49ef-9db7-302077b44a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Flow 'volume_create_manager' (b187d528-bd2c-4d20-85b3-a6362e9fa281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:14 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5bf7effb-38a1-44bc-83d8-decee4ce57e8 tempest-VolumesMetadataTest-441281510 None] Created volume successfully. Jul 05 18:29:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Acquiring lock "cinder-31a99eb2-c272-48bb-acf4-2f59902e6c31-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Lock "cinder-31a99eb2-c272-48bb-acf4-2f59902e6c31-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Acquiring lock "cinder-quobyte-31a99eb2-c272-48bb-acf4-2f59902e6c31" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Lock "cinder-quobyte-31a99eb2-c272-48bb-acf4-2f59902e6c31" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:15 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff799e7-9ad0-4760-9cc8-b186eb02e7e5]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:15 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c 1073741824" returned: 0 in 1.107s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:16 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 Jul 05 18:29:16 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:16 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c Jul 05 18:29:16 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Acquiring lock "cinder-6b0b21f6-fb57-418d-8f55-bab4b1749718-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Lock "cinder-6b0b21f6-fb57-418d-8f55-bab4b1749718-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Acquiring lock "cinder-quobyte-6b0b21f6-fb57-418d-8f55-bab4b1749718" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Lock "cinder-quobyte-6b0b21f6-fb57-418d-8f55-bab4b1749718" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b33576-06b3-4295-9aee-641b0d5806a3]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:16 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 Jul 05 18:29:16 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-e5185810-d35e-496d-bf4c-6b5b04d886d9 req-381938aa-be96-4176-a3f8-1476342a5262 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Terminate volume connection completed successfully. Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-e5185810-d35e-496d-bf4c-6b5b04d886d9 req-381938aa-be96-4176-a3f8-1476342a5262 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Deleting attachment b007e948-371e-4d49-a573-dd683210ad4c. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:29:16 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c" returned: 0 in 0.806s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c58e6b5-5ee1-4a2c-970b-b934934a39b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63896ff-163b-4a15-88d3-bee9174cd827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:16 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Volume volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c (f60d8d81-2206-4e59-8ac2-efc88b66f15c): created successfully Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63896ff-163b-4a15-88d3-bee9174cd827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Flow 'volume_create_manager' (ea9306c5-af33-4418-9945-2803c64829a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c5efa43e-d177-4d4e-ac7f-67c9c20136b6 tempest-VolumesExtendTest-459198428 None] Created volume successfully. Jul 05 18:29:16 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31" returned: 0 in 1.134s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:16 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31 Jul 05 18:29:16 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:17 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718" returned: 0 in 1.014s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:17 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718 Jul 05 18:29:17 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Creating offline snapshot 5a7b90b2-ca7b-411f-a391-44c8765727ae of volume f60d8d81-2206-4e59-8ac2-efc88b66f15c {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9c196d-25c8-462e-898f-3269863c611d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:17 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c Jul 05 18:29:17 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:17 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-31a99eb2-c272-48bb-acf4-2f59902e6c31" returned: 0 in 0.804s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Lock "cinder-quobyte-31a99eb2-c272-48bb-acf4-2f59902e6c31" released by "delete_volume" :: held 2.003s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:17 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Created reservations ['cc72edd4-e208-4f16-9625-1c8eec077c58', '65b246c5-2760-418c-8edb-4472f4ed7f28', 'be78041a-d974-45a1-b7b1-105c168be154', '7d32f825-bf22-4654-888d-30fc4f08dec0'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:18 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:18 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:18 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6b0b21f6-fb57-418d-8f55-bab4b1749718" returned: 0 in 0.895s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Lock "cinder-quobyte-6b0b21f6-fb57-418d-8f55-bab4b1749718" released by "delete_volume" :: held 1.962s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Created reservations ['3b9fc52c-f30d-40fa-855e-d830a7abf797', '91065a1f-afc0-4a0f-8c92-e61552cee3a3', '9f8fad80-e823-4ecb-8436-927cf9aa9ed7', 'b58464ce-2656-4656-840e-51fe6a6dfb88'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:18 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:18 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:18 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c" returned: 0 in 0.974s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:18 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae 1G Jul 05 18:29:18 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:18 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.850s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:18 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Deleted volume successfully. Jul 05 18:29:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbce2ec8-6ebb-41e8-9368-7641f165ac21 tempest-VolumesTransfersV357Test-773846836 None] Lock "cinder-31a99eb2-c272-48bb-acf4-2f59902e6c31-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Acquiring lock "cinder-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "cinder-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Acquiring lock "cinder-quobyte-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "cinder-quobyte-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1ddd16-5ad2-4bcb-a15f-def7d6a1f589]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:19 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.993s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:19 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Deleted volume successfully. Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b90a5f26-c88d-425d-a8a6-f9c5fed8314f tempest-VolumesMetadataTest-441281510 None] Lock "cinder-6b0b21f6-fb57-418d-8f55-bab4b1749718-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:19 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 Jul 05 18:29:19 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:19 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae 1G" returned: 0 in 1.317s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:19 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae Jul 05 18:29:19 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Flow 'volume_create_manager' (44fbd2a6-9fff-4b7b-9b54-2669ff55fd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2726b8-13e8-4914-b167-41bec6c483e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2726b8-13e8-4914-b167-41bec6c483e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-11929725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea8f9b2-7219-497d-b250-5ac18c560790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67abfcb18c614dbabe0a50759d96a20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:20Z,use_quota=True,user_id='60d32ce760804c5cb6b9efc54fd9fe6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078336cd-c7d1-4eee-8019-58a8516d1408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078336cd-c7d1-4eee-8019-58a8516d1408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd9c0bd-fc8b-4e5d-a244-87158472d7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd9c0bd-fc8b-4e5d-a244-87158472d7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea8f9b2-7219-497d-b250-5ac18c560790', 'volume_name': 'volume-0ea8f9b2-7219-497d-b250-5ac18c560790', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dff352-19b5-40d7-ba04-9e2c68272ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dff352-19b5-40d7-ba04-9e2c68272ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed30843-ee67-4f7f-8fd9-48ff30b32602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:20 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Volume 0ea8f9b2-7219-497d-b250-5ac18c560790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea8f9b2-7219-497d-b250-5ac18c560790', 'volume_size': 1} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:20 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44" returned: 0 in 1.213s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:20 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44 Jul 05 18:29:20 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:20 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae" returned: 0 in 1.067s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:20 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae is being set with open permissions: ugo+rw Jul 05 18:29:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:20 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae Jul 05 18:29:20 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:21 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44" returned: 0 in 0.973s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "cinder-quobyte-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44" released by "delete_volume" :: held 2.258s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Created reservations ['db3c3a7f-18ec-4515-a577-12e73701d449', '5dc2b758-7db0-437c-916a-6246c503df13', '9f4d3e8d-b4f1-4407-922a-578be1777628', 'ace5fa79-aa30-4dce-baa3-1aaf56cf6259'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:21 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae" returned: 0 in 0.782s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:21 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:21 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:21 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.info Jul 05 18:29:21 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:22 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.856s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:22 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Deleted volume successfully. Jul 05 18:29:22 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.info" returned: 0 in 0.867s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:22 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.info is being set with open permissions: ugo+rw Jul 05 18:29:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a58e6944-77bb-4f5f-b512-1fa4bde99256 tempest-TestServerVolumeAttachScenarioOldVersion-1513259852 None] Lock "cinder-5f64a852-7f4f-4ca7-829a-0fcf51ed9c44-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:22 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.info Jul 05 18:29:22 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:23 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.info" returned: 0 in 0.937s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.087s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.498s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-11929725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea8f9b2-7219-497d-b250-5ac18c560790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67abfcb18c614dbabe0a50759d96a20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:20Z,use_quota=True,user_id='60d32ce760804c5cb6b9efc54fd9fe6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Creating volume 0ea8f9b2-7219-497d-b250-5ac18c560790 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:23 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:23 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790 1073741824 Jul 05 18:29:23 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:23 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e91020f7-bf86-4532-8a91-13eae704d32f tempest-VolumesExtendTest-459198428 None] Create snapshot completed successfully Jul 05 18:29:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8874fcc8-610d-435f-bca6-f5fc2b2477d9 tempest-VolumesExtendTest-459198428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:24 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790 1073741824" returned: 0 in 1.333s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:24 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790 Jul 05 18:29:24 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Flow 'volume_create_manager' (d28fc266-3054-45aa-acb7-9d97bd3fc7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97ed704-5a5f-4064-8df1-fdaf5d120038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b97ed704-5a5f-4064-8df1-fdaf5d120038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1154133868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db111ea9-7a5e-4261-9934-ac017afc91f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e945e1bcc8242aebc163bd9c03296da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:25Z,use_quota=True,user_id='18503569d0484259aec20cb7b035d6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468dfb1f-3317-4faf-8ff6-de317b10c73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468dfb1f-3317-4faf-8ff6-de317b10c73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5721e0e5-f973-4e74-b0e5-9a9ea7c29f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5721e0e5-f973-4e74-b0e5-9a9ea7c29f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db111ea9-7a5e-4261-9934-ac017afc91f3', 'volume_name': 'volume-db111ea9-7a5e-4261-9934-ac017afc91f3', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db7ea73-1587-4495-9d58-dddd9e1c80dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db7ea73-1587-4495-9d58-dddd9e1c80dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84496730-59b1-4ce6-8b55-2db45704808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:25 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Volume db111ea9-7a5e-4261-9934-ac017afc91f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db111ea9-7a5e-4261-9934-ac017afc91f3', 'volume_size': 1} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:25 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790" returned: 0 in 1.039s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] <== create_volume: return (2433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.438s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8874fcc8-610d-435f-bca6-f5fc2b2477d9 tempest-VolumesExtendTest-459198428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.954s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=102,cinder:UPDATE=115,cinder:INSERT=30,cinder:DELETE=10 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ba3cc8-c5b3-4ae7-83db-fa258b8d00b1]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8874fcc8-610d-435f-bca6-f5fc2b2477d9 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed30843-ee67-4f7f-8fd9-48ff30b32602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea8f9b2-7219-497d-b250-5ac18c560790', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00df0bf-92d3-4ccd-8910-1cf0268d6ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:26 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Volume volume-0ea8f9b2-7219-497d-b250-5ac18c560790 (0ea8f9b2-7219-497d-b250-5ac18c560790): created successfully Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00df0bf-92d3-4ccd-8910-1cf0268d6ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Flow 'volume_create_manager' (44fbd2a6-9fff-4b7b-9b54-2669ff55fd8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:26 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-bc26bc93-c98b-4a7a-928b-8c2e8b50d7df tempest-VolumesTransfersV357Test-1790625202 None] Created volume successfully. Jul 05 18:29:26 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c Jul 05 18:29:26 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Acquiring lock "cinder-0ea8f9b2-7219-497d-b250-5ac18c560790-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Lock "cinder-0ea8f9b2-7219-497d-b250-5ac18c560790-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Acquiring lock "cinder-quobyte-0ea8f9b2-7219-497d-b250-5ac18c560790" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Lock "cinder-quobyte-0ea8f9b2-7219-497d-b250-5ac18c560790" acquired by "delete_volume" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f73edd8-30b3-4e91-bd2d-639696cb45cd]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:27 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8874fcc8-610d-435f-bca6-f5fc2b2477d9 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c" returned: 0 in 1.054s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8874fcc8-610d-435f-bca6-f5fc2b2477d9 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae 2G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:27 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790 Jul 05 18:29:27 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8874fcc8-610d-435f-bca6-f5fc2b2477d9 tempest-VolumesExtendTest-459198428 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae 2G" returned: 0 in 0.168s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8874fcc8-610d-435f-bca6-f5fc2b2477d9 tempest-VolumesExtendTest-459198428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.278s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.838s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1154133868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db111ea9-7a5e-4261-9934-ac017afc91f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e945e1bcc8242aebc163bd9c03296da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:25Z,use_quota=True,user_id='18503569d0484259aec20cb7b035d6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Creating volume db111ea9-7a5e-4261-9934-ac017afc91f3 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:27 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:27 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3 1073741824 Jul 05 18:29:27 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8874fcc8-610d-435f-bca6-f5fc2b2477d9 tempest-VolumesExtendTest-459198428 None] Extend volume completed successfully. Jul 05 18:29:27 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790" returned: 0 in 0.963s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:28 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790 Jul 05 18:29:28 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:28 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3 1073741824" returned: 0 in 1.088s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:28 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3 Jul 05 18:29:28 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Acquiring lock "cinder-5a7b90b2-ca7b-411f-a391-44c8765727ae-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Lock "cinder-5a7b90b2-ca7b-411f-a391-44c8765727ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Acquiring lock "cinder-quobyte-f60d8d81-2206-4e59-8ac2-efc88b66f15c" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Lock "cinder-quobyte-f60d8d81-2206-4e59-8ac2-efc88b66f15c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Acquiring lock "cinder-quobyte-5a7b90b2-ca7b-411f-a391-44c8765727ae" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Lock "cinder-quobyte-5a7b90b2-ca7b-411f-a391-44c8765727ae" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Deleting offline snapshot 5a7b90b2-ca7b-411f-a391-44c8765727ae of volume f60d8d81-2206-4e59-8ac2-efc88b66f15c {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] snapshot_file for this snap is: volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[34130cc3-a584-4033-8d5c-4d482a0da038]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:28 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0ea8f9b2-7219-497d-b250-5ac18c560790" returned: 0 in 0.866s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:28 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae Jul 05 18:29:28 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Lock "cinder-quobyte-0ea8f9b2-7219-497d-b250-5ac18c560790" released by "delete_volume" :: held 1.888s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:28 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Created reservations ['7bdc8824-7dd9-49b5-8f09-23750b50debf', '1cd7e246-6a7e-4403-a768-944ddaed65e1', '08d33102-226f-47bf-a139-aa7b4af33114', '67260fa3-c924-4456-a3e0-907dfc41e189'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:29 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:29 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:29 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3" returned: 0 in 0.800s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84496730-59b1-4ce6-8b55-2db45704808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db111ea9-7a5e-4261-9934-ac017afc91f3', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a10fe49-2aed-400f-8114-98e960e495b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:29 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Volume volume-db111ea9-7a5e-4261-9934-ac017afc91f3 (db111ea9-7a5e-4261-9934-ac017afc91f3): created successfully Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a10fe49-2aed-400f-8114-98e960e495b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Flow 'volume_create_manager' (d28fc266-3054-45aa-acb7-9d97bd3fc7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7131c3a3-d78c-4e5d-be35-1f506b629a0b tempest-VolumesTransfersV355Test-57268203 None] Created volume successfully. Jul 05 18:29:29 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae" returned: 0 in 1.174s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[171c2065-377f-4f51-b76a-c63d88c6efa2]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:30 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.110s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:30 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:30 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c Jul 05 18:29:30 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Deleted volume successfully. Jul 05 18:29:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d8397d05-91a8-487d-91f3-47adfba95c2b tempest-VolumesTransfersV357Test-773846836 None] Lock "cinder-0ea8f9b2-7219-497d-b250-5ac18c560790-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d3a81f5d-f986-49f5-812a-f5e83caf480f tempest-VolumesTransfersV355Test-990171875 None] Transfer volume completed successfully. Jul 05 18:29:31 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c" returned: 0 in 1.149s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:31 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae Jul 05 18:29:31 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Acquiring lock "cinder-db111ea9-7a5e-4261-9934-ac017afc91f3-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Lock "cinder-db111ea9-7a5e-4261-9934-ac017afc91f3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Acquiring lock "cinder-quobyte-db111ea9-7a5e-4261-9934-ac017afc91f3" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Lock "cinder-quobyte-db111ea9-7a5e-4261-9934-ac017afc91f3" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:32 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[17219413-71f1-4149-bef8-a025534c6a1e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:32 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3 Jul 05 18:29:32 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:32 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae" returned: 0 in 1.299s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:32 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae Jul 05 18:29:32 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:33 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3" returned: 0 in 1.265s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:33 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3 Jul 05 18:29:33 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:33 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c.5a7b90b2-ca7b-411f-a391-44c8765727ae" returned: 0 in 1.115s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Lock "cinder-quobyte-5a7b90b2-ca7b-411f-a391-44c8765727ae" released by "_delete_snapshot" :: held 4.917s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Lock "cinder-quobyte-f60d8d81-2206-4e59-8ac2-efc88b66f15c" released by "delete_snapshot" :: held 4.960s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:33 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Created reservations ['fb1d4a39-21b6-403a-8b05-1149772da890', '9af949d7-f531-4514-a2ce-5223317177d5', '1e51acc2-8305-4b65-9e45-506807ee7a6a', 'a4ef1d61-d40f-4e39-b2f4-3d566fd0a2ad'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Delete snapshot completed successfully. Jul 05 18:29:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3037fc3c-196f-4a38-ac06-cfc6da9c19b4 tempest-VolumesExtendTest-459198428 None] Lock "cinder-5a7b90b2-ca7b-411f-a391-44c8765727ae-delete_snapshot" released by "delete_snapshot" :: held 5.192s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Acquiring lock "cinder-f60d8d81-2206-4e59-8ac2-efc88b66f15c-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Lock "cinder-f60d8d81-2206-4e59-8ac2-efc88b66f15c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Acquiring lock "cinder-quobyte-f60d8d81-2206-4e59-8ac2-efc88b66f15c" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Lock "cinder-quobyte-f60d8d81-2206-4e59-8ac2-efc88b66f15c" acquired by "delete_volume" :: waited 0.040s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d0dda1-2bec-4b9a-a2d5-5c622709546c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:34 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db111ea9-7a5e-4261-9934-ac017afc91f3" returned: 0 in 1.169s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:34 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Lock "cinder-quobyte-db111ea9-7a5e-4261-9934-ac017afc91f3" released by "delete_volume" :: held 2.500s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:34 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Created reservations ['65f912c3-ca45-493a-bb33-ee5ec809b259', '5fbac795-af97-41ed-b471-383a355f3f6f', 'f95cb94c-d9bc-4e00-b7aa-73405842087e', 'ee8919e3-292f-499b-9a48-2c2dfd8781ee'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:35 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:35 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:35 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c" returned: 0 in 1.419s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:35 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c Jul 05 18:29:35 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:36 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.392s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:36 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Deleted volume successfully. Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-258caa07-6490-4ce7-8366-609aeee2684f tempest-VolumesTransfersV355Test-1559810636 None] Lock "cinder-db111ea9-7a5e-4261-9934-ac017afc91f3-delete_volume" released by "delete_volume" :: held 4.354s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Flow 'volume_create_manager' (6f5dd9db-3cca-4778-adba-4d9d1cdf96b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae59a48-a708-4b20-9642-464b71af6f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae59a48-a708-4b20-9642-464b71af6f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-383108631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3a1ee1-c09d-4495-8c8b-d1f9f6195357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e945e1bcc8242aebc163bd9c03296da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:37Z,use_quota=True,user_id='18503569d0484259aec20cb7b035d6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa9d85-6bd8-4cf6-bd8b-05b649737df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1fa9d85-6bd8-4cf6-bd8b-05b649737df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c609b371-1c4b-4e74-b22e-c7f31e337b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c609b371-1c4b-4e74-b22e-c7f31e337b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3a1ee1-c09d-4495-8c8b-d1f9f6195357', 'volume_name': 'volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb3ccfb-ea4c-4fe7-95a4-85a9dd231f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb3ccfb-ea4c-4fe7-95a4-85a9dd231f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a290d3-b557-4f29-aeda-978851b7fcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:36 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Volume 7f3a1ee1-c09d-4495-8c8b-d1f9f6195357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357', 'volume_size': 1} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-383108631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3a1ee1-c09d-4495-8c8b-d1f9f6195357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e945e1bcc8242aebc163bd9c03296da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:37Z,use_quota=True,user_id='18503569d0484259aec20cb7b035d6ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Creating volume 7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:36 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:36 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 1073741824 Jul 05 18:29:36 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:37 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f60d8d81-2206-4e59-8ac2-efc88b66f15c" returned: 0 in 1.374s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Lock "cinder-quobyte-f60d8d81-2206-4e59-8ac2-efc88b66f15c" released by "delete_volume" :: held 2.908s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:37 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Created reservations ['56364d22-2732-4be8-930c-1da25123bd4c', '10e86653-d496-4ac4-a94b-5e16f12d15cc', '838b66ab-58a5-4986-9efa-5399ce33a226', '519b3e02-7326-4f88-b0e6-e0a954171338'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:37 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:37 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:38 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 1073741824" returned: 0 in 1.715s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:38 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.092s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:38 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:38 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Deleted volume successfully. Jul 05 18:29:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ff9595c9-f510-4bf9-9310-7e92f875e113 tempest-VolumesExtendTest-459198428 None] Lock "cinder-f60d8d81-2206-4e59-8ac2-efc88b66f15c-delete_volume" released by "delete_volume" :: held 4.408s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:38 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 Jul 05 18:29:38 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Flow 'volume_create_manager' (5bcb330b-a2d3-4102-a54d-3c861402c6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1600ee16-340e-48df-ac89-8e5c6a29a85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1600ee16-340e-48df-ac89-8e5c6a29a85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1159378158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306fc615-c046-4837-86f3-5820416d5253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf8452454d418a97cd4e9626eacd1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:40Z,use_quota=True,user_id='53ab0d28d07942e0837a52199d7022e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f67f9c1-391a-425b-9379-ef425056c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f67f9c1-391a-425b-9379-ef425056c437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d818d4de-b1f9-482f-999f-32406a06b6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d818d4de-b1f9-482f-999f-32406a06b6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306fc615-c046-4837-86f3-5820416d5253', 'volume_name': 'volume-306fc615-c046-4837-86f3-5820416d5253', 'volume_size': 2}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01051d4-950d-4dbd-8a3e-584a5f6186dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01051d4-950d-4dbd-8a3e-584a5f6186dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8beee29-d8d8-47fd-b2c3-c0c21488609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:39 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Volume 306fc615-c046-4837-86f3-5820416d5253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306fc615-c046-4837-86f3-5820416d5253', 'volume_size': 2} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:39 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357" returned: 0 in 1.145s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] <== create_volume: return (2984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.988s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1159378158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306fc615-c046-4837-86f3-5820416d5253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf8452454d418a97cd4e9626eacd1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:40Z,use_quota=True,user_id='53ab0d28d07942e0837a52199d7022e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Creating volume 306fc615-c046-4837-86f3-5820416d5253 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:39 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253 2147483648 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a290d3-b557-4f29-aeda-978851b7fcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c75a15e-1bb6-4ac2-b8af-45570459d8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:39 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253 2147483648 Jul 05 18:29:39 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:39 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Volume volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 (7f3a1ee1-c09d-4495-8c8b-d1f9f6195357): created successfully Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c75a15e-1bb6-4ac2-b8af-45570459d8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Flow 'volume_create_manager' (6f5dd9db-3cca-4778-adba-4d9d1cdf96b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-18c00a99-e604-48eb-8d7e-442d4e7b599f tempest-VolumesTransfersV355Test-57268203 None] Created volume successfully. Jul 05 18:29:41 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253 2147483648" returned: 0 in 1.351s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:41 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253 Jul 05 18:29:41 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Acquiring lock "cinder-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Lock "cinder-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Acquiring lock "cinder-quobyte-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Lock "cinder-quobyte-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357" acquired by "delete_volume" :: waited 0.026s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e27fe2-293d-4260-91c9-bf502e60b9ff]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:41 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 Jul 05 18:29:41 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:42 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253" returned: 0 in 0.902s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] <== create_volume: return (2313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8beee29-d8d8-47fd-b2c3-c0c21488609d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306fc615-c046-4837-86f3-5820416d5253', 'volume_size': 2}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7332c99e-8a0c-4289-8827-67c98bdb37d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:42 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Volume volume-306fc615-c046-4837-86f3-5820416d5253 (306fc615-c046-4837-86f3-5820416d5253): created successfully Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7332c99e-8a0c-4289-8827-67c98bdb37d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Flow 'volume_create_manager' (5bcb330b-a2d3-4102-a54d-3c861402c6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c6ab89a9-bc1c-4f4e-9019-b72f14ef446f tempest-VolumesCloneNegativeTest-1676671847 None] Created volume successfully. Jul 05 18:29:42 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357" returned: 0 in 1.116s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:42 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357 Jul 05 18:29:42 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (04eeffdf-4b3f-4b74-9ba3-6f5aa2e2dc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8252fbf5-0955-4a3c-9bf5-86a67fba1b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8252fbf5-0955-4a3c-9bf5-86a67fba1b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-468243417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2bc8765-bd7f-4554-b27a-5f21782d6c2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:43Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0fc4df-9ec7-4ff7-bc21-d7761f41fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db0fc4df-9ec7-4ff7-bc21-d7761f41fb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad1596e-3bb9-4d16-aade-f7aa718a56b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad1596e-3bb9-4d16-aade-f7aa718a56b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2bc8765-bd7f-4554-b27a-5f21782d6c2f', 'volume_name': 'volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1216b678-61a0-41ba-adfb-0896fdf8db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1216b678-61a0-41ba-adfb-0896fdf8db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0097c6-36fd-4fb0-a31a-5013ec3d8e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:42 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Volume b2bc8765-bd7f-4554-b27a-5f21782d6c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f', 'volume_size': 1} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-468243417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2bc8765-bd7f-4554-b27a-5f21782d6c2f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:43Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Creating volume b2bc8765-bd7f-4554-b27a-5f21782d6c2f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:43 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Acquiring lock "cinder-306fc615-c046-4837-86f3-5820416d5253-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:43 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f 1073741824 Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Lock "cinder-306fc615-c046-4837-86f3-5820416d5253-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:43 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Acquiring lock "cinder-quobyte-306fc615-c046-4837-86f3-5820416d5253" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Lock "cinder-quobyte-306fc615-c046-4837-86f3-5820416d5253" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[da29c7e5-abcc-4fbd-a796-4eb866230647]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:43 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253 Jul 05 18:29:43 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:43 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357" returned: 0 in 1.210s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Lock "cinder-quobyte-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357" released by "delete_volume" :: held 2.440s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:43 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Created reservations ['15866a28-5cdd-48e3-b1ba-bb35dbff4ea3', 'f8c5d8e1-a403-469f-9be5-381413836da3', '79320ff4-dd00-49b6-8dd7-cf795966e37d', '4b282bf7-8403-4825-a7be-6c94e2f89b1c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:44 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:44 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:44 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f 1073741824" returned: 0 in 1.404s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:44 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253" returned: 0 in 1.255s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:44 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253 Jul 05 18:29:44 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:44 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f Jul 05 18:29:44 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:45 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.106s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Deleted volume successfully. Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-47552833-af1c-4caf-8e4e-44af153e69ef tempest-VolumesTransfersV355Test-1559810636 None] Lock "cinder-7f3a1ee1-c09d-4495-8c8b-d1f9f6195357-delete_volume" released by "delete_volume" :: held 3.909s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:45 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-306fc615-c046-4837-86f3-5820416d5253" returned: 0 in 1.152s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Lock "cinder-quobyte-306fc615-c046-4837-86f3-5820416d5253" released by "delete_volume" :: held 2.473s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:45 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f" returned: 0 in 1.202s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] <== create_volume: return (2705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.710s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0097c6-36fd-4fb0-a31a-5013ec3d8e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8b4273-e78a-461d-a403-58ad7602cd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Created reservations ['bf2d832a-6da5-4583-88c2-b1eb9c6953aa', '85114bd9-2635-4075-aed7-5a1878dc72c7', 'a7e46037-48a2-4131-8005-dcd21bcf3b9b', 'f78aa135-6ddb-4deb-ae45-ae046cf12955'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:45 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Volume volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f (b2bc8765-bd7f-4554-b27a-5f21782d6c2f): created successfully Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8b4273-e78a-461d-a403-58ad7602cd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (04eeffdf-4b3f-4b74-9ba3-6f5aa2e2dc38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c745f0c8-ec2d-470c-bf88-a8d7471f59c8 tempest-VolumesGetTest-1348204558 None] Created volume successfully. Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:45 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:45 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:47 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.229s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Deleted volume successfully. Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de74b39-fa4a-4bb7-8a65-128172b9036d tempest-VolumesCloneNegativeTest-1676671847 None] Lock "cinder-306fc615-c046-4837-86f3-5820416d5253-delete_volume" released by "delete_volume" :: held 4.120s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (45178373-816e-480e-8838-6e6a427b2098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae254331-8781-4ff1-9b17-50f5aec38b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae254331-8781-4ff1-9b17-50f5aec38b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1606354889',display_name='tempest-VolumesGetTest-Volume-1051328608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea046f8-b5f8-4e50-8ee5-7566c6d62a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:47Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cb332a-e853-4cc3-8312-efd75905d032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cb332a-e853-4cc3-8312-efd75905d032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf547ea0-f4ae-488f-9336-e656db824fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf547ea0-f4ae-488f-9336-e656db824fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea046f8-b5f8-4e50-8ee5-7566c6d62a9b', 'volume_name': 'volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc02d56c-b043-4d1b-af04-f8d3f6f04b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc02d56c-b043-4d1b-af04-f8d3f6f04b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebd4e3a-5fb8-4e03-8b7a-b63782710a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:47 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Volume bea046f8-b5f8-4e50-8ee5-7566c6d62a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b', 'volume_size': 1} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1606354889',display_name='tempest-VolumesGetTest-Volume-1051328608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea046f8-b5f8-4e50-8ee5-7566c6d62a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:47Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Creating volume bea046f8-b5f8-4e50-8ee5-7566c6d62a9b {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:47 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:47 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b 1073741824 Jul 05 18:29:47 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:48 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b 1073741824" returned: 0 in 1.265s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:48 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b Jul 05 18:29:48 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:49 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b" returned: 0 in 1.077s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] <== create_volume: return (2415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.420s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebd4e3a-5fb8-4e03-8b7a-b63782710a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df0cfd3-4ef9-4746-90e5-a3306857cffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:49 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Volume volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b (bea046f8-b5f8-4e50-8ee5-7566c6d62a9b): created successfully Jul 05 18:29:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df0cfd3-4ef9-4746-90e5-a3306857cffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (45178373-816e-480e-8838-6e6a427b2098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:50 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-40d17f93-8243-46ae-a9ac-8b1d23cd1c6e tempest-VolumesGetTest-1348204558 None] Created volume successfully. Jul 05 18:29:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Lock "cinder-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-quobyte-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:51 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd7cd4-772c-49b4-9e8a-e82982d8d395]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:51 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b Jul 05 18:29:51 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:52 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b" returned: 0 in 1.051s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:52 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b Jul 05 18:29:52 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:52 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b" returned: 0 in 0.813s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b" released by "delete_volume" :: held 1.950s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Created reservations ['b7dd2588-d6a5-46e2-a3a6-5641680cd3c6', '5d47bc94-3321-484f-9af2-bef9159dbae7', '9ba5bb41-513c-4343-814e-e7630a1e40ae', 'bb2795fd-c6ed-4298-bec7-ab506273f919'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:53 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:53 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-b2bc8765-bd7f-4554-b27a-5f21782d6c2f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Lock "cinder-b2bc8765-bd7f-4554-b27a-5f21782d6c2f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-quobyte-b2bc8765-bd7f-4554-b27a-5f21782d6c2f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-b2bc8765-bd7f-4554-b27a-5f21782d6c2f" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ca130d-99b5-4ae9-81cd-57d3d51330aa]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:53 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f Jul 05 18:29:53 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:54 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.178s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Deleted volume successfully. Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-16ff19f5-67be-4608-a559-92788945c951 tempest-VolumesGetTest-1348204558 None] Lock "cinder-bea046f8-b5f8-4e50-8ee5-7566c6d62a9b-delete_volume" released by "delete_volume" :: held 3.528s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Flow 'volume_create_manager' (b9fcf819-f8ef-42c1-9e11-4d059f3990a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b0f5b1-36a5-40f5-96f7-faf4d46bc4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b0f5b1-36a5-40f5-96f7-faf4d46bc4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2085561239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3f0d9d-3285-4ba7-90ea-53be622fafe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a266c1ba894f7e876595610ede8d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:54Z,use_quota=True,user_id='6f8afaca374c4245a57a6b81d4fb2d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f65bc69-a35d-4af2-847c-771423fe8c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f65bc69-a35d-4af2-847c-771423fe8c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdc90b9-0883-470a-9592-790e69312dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdc90b9-0883-470a-9592-790e69312dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3f0d9d-3285-4ba7-90ea-53be622fafe5', 'volume_name': 'volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38119745-8e5c-4f4f-acb0-4cfc5bf56498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38119745-8e5c-4f4f-acb0-4cfc5bf56498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49714347-ec04-4b07-be49-9683bc20359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:54 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Volume 6e3f0d9d-3285-4ba7-90ea-53be622fafe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5', 'volume_size': 1} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2085561239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3f0d9d-3285-4ba7-90ea-53be622fafe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a266c1ba894f7e876595610ede8d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:54Z,use_quota=True,user_id='6f8afaca374c4245a57a6b81d4fb2d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Creating volume 6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:54 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:54 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 1073741824 Jul 05 18:29:54 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:54 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f" returned: 0 in 1.269s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:54 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f Jul 05 18:29:54 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:55 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 1073741824" returned: 0 in 1.256s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:55 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b2bc8765-bd7f-4554-b27a-5f21782d6c2f" returned: 0 in 1.062s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-b2bc8765-bd7f-4554-b27a-5f21782d6c2f" released by "delete_volume" :: held 2.420s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:55 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 Jul 05 18:29:55 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Created reservations ['1bf6c5a1-2f2a-4586-8b80-2bbd387becad', 'da82b70f-a28a-419e-9fa7-6509e934594b', '2a46d826-458b-42a0-aa72-718cb8ce4180', '64791a84-5d28-47fb-b335-1bd6ba8a9d3c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:56 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:29:56 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Flow 'volume_create_manager' (fd8fcab6-b388-4e91-a339-85267e953ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212f81c2-3f1b-4a8f-ac6b-920f8950fbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212f81c2-3f1b-4a8f-ac6b-920f8950fbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-517081177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f265c1-5ac0-4038-a550-8b66f469b2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44272c24e87c4af7997c5340e91b9870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:56Z,use_quota=True,user_id='e4b7aa0fafb749d49c533020ce30100b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef36eb95-c244-4ee2-8a61-33f08f574ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef36eb95-c244-4ee2-8a61-33f08f574ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f426d921-6cbf-4c8c-8876-b3ef46190ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f426d921-6cbf-4c8c-8876-b3ef46190ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f265c1-5ac0-4038-a550-8b66f469b2ec', 'volume_name': 'volume-86f265c1-5ac0-4038-a550-8b66f469b2ec', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71e9158-8b38-4428-af2e-3ba8287c8d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71e9158-8b38-4428-af2e-3ba8287c8d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3433642c-1557-47a3-98fb-5c447e6190b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Volume 86f265c1-5ac0-4038-a550-8b66f469b2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f265c1-5ac0-4038-a550-8b66f469b2ec', 'volume_size': 1} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Flow 'volume_create_manager' (e0ea4dd7-aeb2-423d-9d1d-ebf495f1d879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5e47dc-898c-45d2-ad57-53a2fe1b9f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5e47dc-898c-45d2-ad57-53a2fe1b9f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb543d4b-00d5-4408-8dfa-373f3c06fc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69dc21426d464848b85177bde9d2fffd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:57Z,use_quota=True,user_id='688329281a3947d1897465d1f51c110b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc64847-deda-4487-be0b-bea13619344c),volume_type_id=edc64847-deda-4487-be0b-bea13619344c)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3af132-46ef-43bf-93e7-54ce01846aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3af132-46ef-43bf-93e7-54ce01846aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbd5bdd-916e-4a23-8d68-18d72e82e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.image.glance [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Creating Keystone auth plugin from conf {{(pid=86664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 18:29:56 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" returned: 0 in 0.946s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-517081177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f265c1-5ac0-4038-a550-8b66f469b2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44272c24e87c4af7997c5340e91b9870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:56Z,use_quota=True,user_id='e4b7aa0fafb749d49c533020ce30100b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Creating volume 86f265c1-5ac0-4038-a550-8b66f469b2ec {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:56 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49714347-ec04-4b07-be49-9683bc20359a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:56 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec 1073741824 Jul 05 18:29:56 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c27288-b14c-4d92-af94-6fd7f2b73da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Volume volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 (6e3f0d9d-3285-4ba7-90ea-53be622fafe5): created successfully Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c27288-b14c-4d92-af94-6fd7f2b73da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Flow 'volume_create_manager' (b9fcf819-f8ef-42c1-9e11-4d059f3990a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9766b953-b72f-4869-9c4e-22e6256ccd86 tempest-VolumesCloneTest-167387383 None] Created volume successfully. Jul 05 18:29:57 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.860s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:29:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Deleted volume successfully. Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-79dd0629-830d-40ff-b71d-cb73a99289d8 tempest-VolumesGetTest-1348204558 None] Lock "cinder-b2bc8765-bd7f-4554-b27a-5f21782d6c2f-delete_volume" released by "delete_volume" :: held 3.769s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbd5bdd-916e-4a23-8d68-18d72e82e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb543d4b-00d5-4408-8dfa-373f3c06fc1b', 'volume_name': 'volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b', 'volume_size': 1, 'image_id': '02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3dfd146e6b0fab7135dfa26b05dea63', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69dc21426d464848b85177bde9d2fffd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2da7eba15a6eda127209539c8ea17060739b68158ccec610f350f2dd4810e1968f5fe06dd916d2b49126ffd452af0de8fa2d8efd7b2a7208000448d0b44b030d', 'id': '02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'created_at': datetime.datetime(2026, 7, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02f6d051-86af-4e10-ab4f-dfc62d2ac743/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558ebc16-8893-4556-a529-e2241dee9389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558ebc16-8893-4556-a529-e2241dee9389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ed07c6-07f4-4344-8f75-af5ab99c23dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:57 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Volume eb543d4b-00d5-4408-8dfa-373f3c06fc1b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b', 'volume_size': 1, 'image_id': '02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3dfd146e6b0fab7135dfa26b05dea63', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69dc21426d464848b85177bde9d2fffd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2da7eba15a6eda127209539c8ea17060739b68158ccec610f350f2dd4810e1968f5fe06dd916d2b49126ffd452af0de8fa2d8efd7b2a7208000448d0b44b030d', 'id': '02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'created_at': datetime.datetime(2026, 7, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02f6d051-86af-4e10-ab4f-dfc62d2ac743/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Trying to clone eb543d4b-00d5-4408-8dfa-373f3c06fc1b from image 02f6d051-86af-4e10-ab4f-dfc62d2ac743 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'metadata': {}}]). {{(pid=86664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 18:29:57 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Image download 0.00 MB at 0.00 MB/s Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0052aca-3672-40e0-9d34-0e24fc9d7778]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:57 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD Jul 05 18:29:57 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (539ffcd8-c189-4b2e-a6c6-39a4c6b225a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15fc110-6aae-48fe-8b96-e9a75297567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15fc110-6aae-48fe-8b96-e9a75297567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1291384194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d32a6f-c575-4078-926a-56c70249f2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:58Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9ac7d1-6b6d-4e01-b4a9-714d2bd1fc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9ac7d1-6b6d-4e01-b4a9-714d2bd1fc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df35bac-61d1-47d6-a845-395301ffb504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df35bac-61d1-47d6-a845-395301ffb504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d32a6f-c575-4078-926a-56c70249f2aa', 'volume_name': 'volume-b1d32a6f-c575-4078-926a-56c70249f2aa', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b90a056-07ab-438b-9bb5-47ab6dd84b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b90a056-07ab-438b-9bb5-47ab6dd84b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579ff0e0-b09f-403f-9669-c528d88485b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Volume b1d32a6f-c575-4078-926a-56c70249f2aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d32a6f-c575-4078-926a-56c70249f2aa', 'volume_size': 1} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:58 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec 1073741824" returned: 0 in 1.278s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:58 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec Jul 05 18:29:58 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Flow 'volume_create_manager' (e024b13d-9d85-4979-9c35-45a11b15e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2af2286-6bfa-4bdf-8880-effc4300a074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2af2286-6bfa-4bdf-8880-effc4300a074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-482946035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04123349-2438-442b-87de-c7a0220f6084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a266c1ba894f7e876595610ede8d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6e3f0d9d-3285-4ba7-90ea-53be622fafe5,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:58Z,use_quota=True,user_id='6f8afaca374c4245a57a6b81d4fb2d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a3e8cf-ee23-402c-991b-4fd085818904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a3e8cf-ee23-402c-991b-4fd085818904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a28bbb-910c-489f-b1ea-dcd33e057464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a28bbb-910c-489f-b1ea-dcd33e057464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '04123349-2438-442b-87de-c7a0220f6084', 'volume_name': 'volume-04123349-2438-442b-87de-c7a0220f6084', 'volume_size': 2, 'source_volid': '6e3f0d9d-3285-4ba7-90ea-53be622fafe5', 'source_volstatus': 'available'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14cbf0f-f848-484e-94c1-f567ac82f71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a14cbf0f-f848-484e-94c1-f567ac82f71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e168a5-6772-4835-8555-35af66787e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Volume 04123349-2438-442b-87de-c7a0220f6084: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-04123349-2438-442b-87de-c7a0220f6084', 'volume_size': 2, 'source_volid': '6e3f0d9d-3285-4ba7-90ea-53be622fafe5', 'source_volstatus': 'available'} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD" returned: 0 in 1.202s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:58 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD Jul 05 18:29:58 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:59 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec" returned: 0 in 0.854s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1291384194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d32a6f-c575-4078-926a-56c70249f2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:58Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Creating volume b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:29:59 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:59 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa 1073741824 Jul 05 18:29:59 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3433642c-1557-47a3-98fb-5c447e6190b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f265c1-5ac0-4038-a550-8b66f469b2ec', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40734888-b7fa-4f55-95a0-7166c320830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:29:59 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Volume volume-86f265c1-5ac0-4038-a550-8b66f469b2ec (86f265c1-5ac0-4038-a550-8b66f469b2ec): created successfully Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40734888-b7fa-4f55-95a0-7166c320830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Flow 'volume_create_manager' (fd8fcab6-b388-4e91-a339-85267e953ed1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:29:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3274735b-1457-420e-ae52-0ab521753bac tempest-VolumesNegativeTest-1204838230 None] Created volume successfully. Jul 05 18:29:59 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD" returned: 1 in 0.814s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Temporary image 02f6d051-86af-4e10-ab4f-dfc62d2ac743 is fetched for user 688329281a3947d1897465d1f51c110b. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5167d7e0-9797-4ec1-b2da-58cd79a2b3cc]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:29:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:29:59 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD Jul 05 18:29:59 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:00 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa 1073741824" returned: 0 in 1.050s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:00 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa Jul 05 18:30:00 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:00 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD" returned: 0 in 0.911s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:00 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD Jul 05 18:30:00 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:00 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa" returned: 0 in 0.789s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:30:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.336s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:01 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Cloning volume 6e3f0d9d-3285-4ba7-90ea-53be622fafe5 to volume 04123349-2438-442b-87de-c7a0220f6084 Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579ff0e0-b09f-403f-9669-c528d88485b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d32a6f-c575-4078-926a-56c70249f2aa', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0872aebc-12e2-4a36-b436-38b4ebc7fcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:01 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Volume volume-b1d32a6f-c575-4078-926a-56c70249f2aa (b1d32a6f-c575-4078-926a-56c70249f2aa): created successfully Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0872aebc-12e2-4a36-b436-38b4ebc7fcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (539ffcd8-c189-4b2e-a6c6-39a4c6b225a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Creating offline snapshot 5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 of volume 6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f84ae-8ca5-4ef7-bdeb-5ac3012f2fdb]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-34fe9bd3-674c-418b-8131-81e28cfb3a3e tempest-VolumesGetTest-1348204558 None] Created volume successfully. Jul 05 18:30:01 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 Jul 05 18:30:01 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:01 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD" returned: 1 in 0.828s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:01 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" returned: 0 in 0.849s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:01 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 1G Jul 05 18:30:01 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=121,cinder:INSERT=42,cinder:UPDATE=151,cinder:DELETE=15 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (30e977dc-db84-4260-8417-d703ea9d145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8daedce5-c283-4e99-81a3-b4a6def07c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8daedce5-c283-4e99-81a3-b4a6def07c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1527588857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5abcbd4-56f0-46a0-b7c8-8a3495145d55,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b1d32a6f-c575-4078-926a-56c70249f2aa,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:03Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d738693e-6fbb-4850-845b-951938f8e4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d738693e-6fbb-4850-845b-951938f8e4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df2424c-df70-4fa8-a18d-54aa6fb509b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df2424c-df70-4fa8-a18d-54aa6fb509b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a5abcbd4-56f0-46a0-b7c8-8a3495145d55', 'volume_name': 'volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55', 'volume_size': 1, 'source_volid': 'b1d32a6f-c575-4078-926a-56c70249f2aa', 'source_volstatus': 'available'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024dc47b-52e8-44be-9591-bfbb391c2f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (024dc47b-52e8-44be-9591-bfbb391c2f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa3161f-e27e-4581-9044-d5d2efea9c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:02 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Volume a5abcbd4-56f0-46a0-b7c8-8a3495145d55: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55', 'volume_size': 1, 'source_volid': 'b1d32a6f-c575-4078-926a-56c70249f2aa', 'source_volstatus': 'available'} Jul 05 18:30:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:03 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 1G" returned: 0 in 1.106s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:03 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 Jul 05 18:30:03 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:03 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2" returned: 0 in 0.790s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:03 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 is being set with open permissions: ugo+rw Jul 05 18:30:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:03 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 Jul 05 18:30:03 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:04 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2" returned: 0 in 0.695s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:04 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.info Jul 05 18:30:04 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:05 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.info" returned: 0 in 0.836s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:05 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.info is being set with open permissions: ugo+rw Jul 05 18:30:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:05 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.info Jul 05 18:30:05 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:06 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.info" returned: 0 in 0.852s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Acquiring lock "cinder-quobyte-04123349-2438-442b-87de-c7a0220f6084" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Lock "cinder-quobyte-04123349-2438-442b-87de-c7a0220f6084" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] snapshot: 5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2, volume: 04123349-2438-442b-87de-c7a0220f6084, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3b8182-0bdd-4ec7-ab3c-5cc581bac7ac]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:06 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 Jul 05 18:30:06 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:07 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2" returned: 0 in 1.219s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:30:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:30:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:30:07 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30db3ea-7f19-439a-8395-6c148b37794b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:07 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 Jul 05 18:30:07 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:08 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" returned: 0 in 0.918s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:08 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:30:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:08 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 Jul 05 18:30:08 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:30:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:12 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:30:12 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:14 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 2.186s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:DELETE=7,cinder:SELECT=61,cinder:UPDATE=99,cinder:INSERT=18 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=3,cinder:INSERT=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:30:14 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084" returned: 0 in 6.305s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc6c46e-6abe-4438-892d-1d80f83952ed]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:14 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 Jul 05 18:30:14 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:16 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" returned: 0 in 1.218s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:16 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:30:16 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Converted 1024.00 MB image at 162.35 MB/s Jul 05 18:30:16 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 is being set with open permissions: ugo+rw Jul 05 18:30:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:16 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 Jul 05 18:30:16 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:16 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084" returned: 0 in 0.863s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Lock "cinder-quobyte-04123349-2438-442b-87de-c7a0220f6084" released by "_copy_volume_from_snapshot" :: held 10.629s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Acquiring lock "cinder-quobyte-5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Lock "cinder-quobyte-5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Deleting offline snapshot 5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 of volume 6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:30:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] snapshot_file for this snap is: volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:30:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2032062-053c-4979-aa17-f450ef1f29a4]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:17 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 Jul 05 18:30:17 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:18 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2" returned: 0 in 0.983s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:30:18 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc93b690-3dc5-4efa-bbaf-92f21fea5dbd]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:18 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 Jul 05 18:30:18 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:19 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" returned: 0 in 1.105s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:19 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 Jul 05 18:30:19 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:20 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2" returned: 0 in 0.870s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:20 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2 Jul 05 18:30:20 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:20 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5.5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2" returned: 0 in 0.916s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Lock "cinder-quobyte-5b9c7b88-bbbe-41be-a2a6-dc96bc6812c2" released by "_delete_snapshot" :: held 4.058s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.105s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.830s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb543d4b-00d5-4408-8dfa-373f3c06fc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69dc21426d464848b85177bde9d2fffd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:29:57Z,use_quota=True,user_id='688329281a3947d1897465d1f51c110b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc64847-deda-4487-be0b-bea13619344c),volume_type_id=edc64847-deda-4487-be0b-bea13619344c)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Creating volume eb543d4b-00d5-4408-8dfa-373f3c06fc1b {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:30:21 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e168a5-6772-4835-8555-35af66787e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04123349-2438-442b-87de-c7a0220f6084', 'volume_size': 2, 'source_volid': '6e3f0d9d-3285-4ba7-90ea-53be622fafe5', 'source_volstatus': 'available'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:21 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b 1073741824 Jul 05 18:30:21 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ef8a1c-8314-4abf-9f8d-cfd79994a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:21 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Volume volume-04123349-2438-442b-87de-c7a0220f6084 (04123349-2438-442b-87de-c7a0220f6084): created successfully Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ef8a1c-8314-4abf-9f8d-cfd79994a538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Flow 'volume_create_manager' (e024b13d-9d85-4979-9c35-45a11b15e636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:21 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-54c557ae-f0cb-40af-9668-348b52927599 tempest-VolumesCloneTest-167387383 None] Created volume successfully. Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Acquiring lock "cinder-04123349-2438-442b-87de-c7a0220f6084-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Lock "cinder-04123349-2438-442b-87de-c7a0220f6084-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Acquiring lock "cinder-quobyte-04123349-2438-442b-87de-c7a0220f6084" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Lock "cinder-quobyte-04123349-2438-442b-87de-c7a0220f6084" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:22 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef805225-162b-4988-9488-725eed519a70]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:22 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 Jul 05 18:30:22 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:22 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b 1073741824" returned: 0 in 1.291s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:22 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b Jul 05 18:30:22 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:23 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084" returned: 0 in 0.946s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:23 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084 Jul 05 18:30:23 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:23 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" returned: 0 in 0.898s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 20.385s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:23 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Cloning volume b1d32a6f-c575-4078-926a-56c70249f2aa to volume a5abcbd4-56f0-46a0-b7c8-8a3495145d55 Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Attempting download of 02f6d051-86af-4e10-ab4f-dfc62d2ac743 ((None, [{'url': 'file:///opt/stack/data/glance/images/02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'metadata': {}}])) to volume eb543d4b-00d5-4408-8dfa-373f3c06fc1b. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Creating offline snapshot 493fb558-2a92-4710-9b83-271c0f05c4b2 of volume b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f89b6eb-b942-40d4-829d-7dd8d7a8eb5c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d10490-afbc-44fe-8082-2434a435fa3d]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02f6d051-86af-4e10-ab4f-dfc62d2ac743__9m8ghpl {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:23 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa Jul 05 18:30:23 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:23 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02f6d051-86af-4e10-ab4f-dfc62d2ac743__9m8ghpl Jul 05 18:30:23 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:24 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-04123349-2438-442b-87de-c7a0220f6084" returned: 0 in 1.026s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Lock "cinder-quobyte-04123349-2438-442b-87de-c7a0220f6084" released by "delete_volume" :: held 2.026s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Created reservations ['61d1dad2-d7d2-4d12-83fc-a53e786fc27f', '0dc5b52e-fa92-4966-a7c9-3aa6d8e1d0d0', '2ea318ca-eada-4de4-901d-f6ca47e0b80b', '80dbf8ee-4b88-49a3-a39a-636be0b7e74a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:24 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:30:24 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:24 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa" returned: 0 in 0.968s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:24 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 1G Jul 05 18:30:24 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:24 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02f6d051-86af-4e10-ab4f-dfc62d2ac743__9m8ghpl" returned: 0 in 1.167s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02f6d051-86af-4e10-ab4f-dfc62d2ac743__9m8ghpl {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:24 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02f6d051-86af-4e10-ab4f-dfc62d2ac743__9m8ghpl Jul 05 18:30:24 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:25 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.927s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:30:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Deleted volume successfully. Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c699d791-4e62-48f3-a681-1c21aa234cc5 tempest-VolumesCloneTest-167387383 None] Lock "cinder-04123349-2438-442b-87de-c7a0220f6084-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Acquiring lock "cinder-6e3f0d9d-3285-4ba7-90ea-53be622fafe5-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Lock "cinder-6e3f0d9d-3285-4ba7-90ea-53be622fafe5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Acquiring lock "cinder-quobyte-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:25 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Lock "cinder-quobyte-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 1G" returned: 0 in 1.162s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d32a6f-c575-4078-926a-56c70249f2aa -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e93a9e-ae9f-4b23-acc7-166ecb86be46]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:25 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d32a6f-c575-4078-926a-56c70249f2aa -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 Jul 05 18:30:25 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:25 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02f6d051-86af-4e10-ab4f-dfc62d2ac743__9m8ghpl" returned: 1 in 1.034s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02f6d051-86af-4e10-ab4f-dfc62d2ac743__9m8ghpl' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc528605-1380-4e54-9b1d-7aa83f2f155e]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:25 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 Jul 05 18:30:25 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:25 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD Jul 05 18:30:25 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:26 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d32a6f-c575-4078-926a-56c70249f2aa -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2" returned: 0 in 1.013s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:26 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 is being set with open permissions: ugo+rw Jul 05 18:30:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:26 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 Jul 05 18:30:26 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:26 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" returned: 0 in 1.111s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:26 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5 Jul 05 18:30:26 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:26 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD" returned: 0 in 1.111s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:27 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD Jul 05 18:30:27 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:27 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2" returned: 0 in 0.856s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:27 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.info Jul 05 18:30:27 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:27 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" returned: 0 in 0.888s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Lock "cinder-quobyte-6e3f0d9d-3285-4ba7-90ea-53be622fafe5" released by "delete_volume" :: held 2.106s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Created reservations ['880e136d-7a49-4de2-827b-1300a96c302a', '3ca4b2b7-0867-4678-b3e1-c2e075585cf8', '5aaf36d7-de3b-4bf7-baa4-cacf720958ed', '18967a79-fbb2-4ed4-b97e-3667f9672974'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:27 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD" returned: 1 in 1.130s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] 02f6d051-86af-4e10-ab4f-dfc62d2ac743 was raw, converting to raw {{(pid=86664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 18:30:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:28 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:30:28 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:28 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b Jul 05 18:30:28 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:28 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.info" returned: 0 in 0.891s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:28 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.info is being set with open permissions: ugo+rw Jul 05 18:30:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:28 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.info Jul 05 18:30:28 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:28 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.964s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:28 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:30:28 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Deleted volume successfully. Jul 05 18:30:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d9e4dce5-6069-4aa9-924f-f18b5f854730 tempest-VolumesCloneTest-167387383 None] Lock "cinder-6e3f0d9d-3285-4ba7-90ea-53be622fafe5-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:29 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" returned: 0 in 1.094s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02f6d051-86af-4e10-ab4f-dfc62d2ac743_myu0u6n9devstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:30:29 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:29 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b 1G Jul 05 18:30:29 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:29 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.info" returned: 0 in 1.015s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-quobyte-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] snapshot: 493fb558-2a92-4710-9b83-271c0f05c4b2, volume: a5abcbd4-56f0-46a0-b7c8-8a3495145d55, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0101911-e033-4a87-9df4-0560d279d4d4]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:29 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 Jul 05 18:30:29 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:30 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b 1G" returned: 0 in 1.056s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:30 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e3106a-061e-4f70-bcbc-18e8f7ef499a]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:30 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b Jul 05 18:30:30 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:30 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2" returned: 0 in 1.033s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1d32a6f-c575-4078-926a-56c70249f2aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:30:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:30:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:30:30 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[416e7924-9edc-4c38-8c7d-003876e35fe1]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:30 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa Jul 05 18:30:30 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:31 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" returned: 0 in 1.053s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:31 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b Jul 05 18:30:31 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:31 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa" returned: 0 in 1.029s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:31 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:30:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:31 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 Jul 05 18:30:31 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:32 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" returned: 1 in 1.018s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Downloaded image 02f6d051-86af-4e10-ab4f-dfc62d2ac743 ((None, [{'url': 'file:///opt/stack/data/glance/images/02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'metadata': {}}])) to volume eb543d4b-00d5-4408-8dfa-373f3c06fc1b successfully. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Temporary image 02f6d051-86af-4e10-ab4f-dfc62d2ac743 for user 688329281a3947d1897465d1f51c110b is deleted. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Marking volume eb543d4b-00d5-4408-8dfa-373f3c06fc1b as bootable. {{(pid=86664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Copying metadata from image 02f6d051-86af-4e10-ab4f-dfc62d2ac743 to eb543d4b-00d5-4408-8dfa-373f3c06fc1b. {{(pid=86664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Creating volume glance metadata for volume eb543d4b-00d5-4408-8dfa-373f3c06fc1b backed by image 02f6d051-86af-4e10-ab4f-dfc62d2ac743 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e3dfd146e6b0fab7135dfa26b05dea63', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ed07c6-07f4-4344-8f75-af5ab99c23dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b', 'volume_size': 1, 'image_id': '02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e3dfd146e6b0fab7135dfa26b05dea63', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69dc21426d464848b85177bde9d2fffd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2da7eba15a6eda127209539c8ea17060739b68158ccec610f350f2dd4810e1968f5fe06dd916d2b49126ffd452af0de8fa2d8efd7b2a7208000448d0b44b030d', 'id': '02f6d051-86af-4e10-ab4f-dfc62d2ac743', 'created_at': datetime.datetime(2026, 7, 5, 16, 29, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 29, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02f6d051-86af-4e10-ab4f-dfc62d2ac743/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e529ebd7-2525-485a-be2c-e7dd4ac1953f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:32 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Volume volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b (eb543d4b-00d5-4408-8dfa-373f3c06fc1b): created successfully Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e529ebd7-2525-485a-be2c-e7dd4ac1953f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Flow 'volume_create_manager' (e0ea4dd7-aeb2-423d-9d1d-ebf495f1d879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fc07893b-f7d5-4b26-8187-f4818e90c585 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Created volume successfully. Jul 05 18:30:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Acquiring lock "cinder-eb543d4b-00d5-4408-8dfa-373f3c06fc1b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "cinder-eb543d4b-00d5-4408-8dfa-373f3c06fc1b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Acquiring lock "cinder-quobyte-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "cinder-quobyte-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" acquired by "delete_volume" :: waited 0.042s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:33 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3739ad46-6ac3-4754-84a9-6758ac775d01]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Flow 'volume_create_manager' (5811926e-4de1-4d6f-a6fb-afce0e31b788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f2245f-a9a7-4107-929c-52322676a8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:34 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b Jul 05 18:30:34 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f2245f-a9a7-4107-929c-52322676a8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-836761411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310ec23a-e80a-42b0-8141-bf543fb12681,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a261a732d3174959895b1405a918742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:34Z,use_quota=True,user_id='1c4a199aa7ee407184a236eb4a8e93db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701925b3-d489-4b18-959c-54fad65e0373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701925b3-d489-4b18-959c-54fad65e0373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3abb31-6947-46a0-a8ca-26024a769d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3abb31-6947-46a0-a8ca-26024a769d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310ec23a-e80a-42b0-8141-bf543fb12681', 'volume_name': 'volume-310ec23a-e80a-42b0-8141-bf543fb12681', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3495e564-bfa7-4497-94a0-c6ec884d2960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3495e564-bfa7-4497-94a0-c6ec884d2960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6c401b-47cb-4893-acf1-c61e3b292003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:34 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Volume 310ec23a-e80a-42b0-8141-bf543fb12681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310ec23a-e80a-42b0-8141-bf543fb12681', 'volume_size': 1} Jul 05 18:30:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:36 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" returned: 0 in 2.469s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:36 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b Jul 05 18:30:36 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:38 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" returned: 1 in 2.223s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:38 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b Jul 05 18:30:38 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Acquiring lock "cinder-86f265c1-5ac0-4038-a550-8b66f469b2ec-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Lock "cinder-86f265c1-5ac0-4038-a550-8b66f469b2ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Acquiring lock "cinder-quobyte-86f265c1-5ac0-4038-a550-8b66f469b2ec" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Lock "cinder-quobyte-86f265c1-5ac0-4038-a550-8b66f469b2ec" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:38 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" returned: 0 in 6.981s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0e9dea-074d-4aa8-a914-1be15c44d4bb]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4af6863-e837-438e-b1c6-71569b1a08d2]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:38 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec Jul 05 18:30:38 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:38 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa Jul 05 18:30:38 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:39 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" returned: 0 in 0.866s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "cinder-quobyte-eb543d4b-00d5-4408-8dfa-373f3c06fc1b" released by "delete_volume" :: held 5.763s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:39 devstack cinder-volume[86664]: WARNING cinder.quota [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:30:39 devstack cinder-volume[86664]: WARNING cinder.quota [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Created reservations ['196af7c3-2826-4190-ac7d-711682a03d2c', 'dfa39b4a-1244-42af-aac1-6c4454c38cc2', '9462becd-8880-4c62-b3f4-b60cd6f370b1', '23b6f14f-d70e-4215-a39d-a6426f0bf73b'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:39 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:30:39 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:39 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec" returned: 0 in 0.828s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:39 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec Jul 05 18:30:39 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:39 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa" returned: 0 in 1.046s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:30:39 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Converted 1024.00 MB image at 146.65 MB/s Jul 05 18:30:39 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 is being set with open permissions: ugo+rw Jul 05 18:30:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:39 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 Jul 05 18:30:39 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:40 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.723s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:30:40 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Deleted volume successfully. Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7f52164a-007e-4236-96ce-4ce3825bde83 tempest-VolumeAndVolumeTypeFromImageTest-1782282774 None] Lock "cinder-eb543d4b-00d5-4408-8dfa-373f3c06fc1b-delete_volume" released by "delete_volume" :: held 6.889s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:40 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-86f265c1-5ac0-4038-a550-8b66f469b2ec" returned: 0 in 0.723s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Lock "cinder-quobyte-86f265c1-5ac0-4038-a550-8b66f469b2ec" released by "delete_volume" :: held 1.598s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Created reservations ['31513eb4-df29-49f4-9cd4-9afbaf64e0b2', '7c96604d-ae74-480e-9b12-8cc304064344', 'ae83fe9e-a737-4f54-ba8f-f6b8273f9426', 'aaa08516-00a2-44c7-86b8-a7d8f8f07b2e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:40 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:30:40 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:40 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" returned: 0 in 0.768s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" released by "_copy_volume_from_snapshot" :: held 11.017s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-quobyte-493fb558-2a92-4710-9b83-271c0f05c4b2" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-493fb558-2a92-4710-9b83-271c0f05c4b2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Deleting offline snapshot 493fb558-2a92-4710-9b83-271c0f05c4b2 of volume b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] snapshot_file for this snap is: volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f01d3-6352-4efa-ba22-27ee766a1198]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:40 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 Jul 05 18:30:40 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:41 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.869s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:41 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:30:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Deleted volume successfully. Jul 05 18:30:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-623ba075-6771-4ccb-80f7-db0278198517 tempest-VolumesNegativeTest-1204838230 None] Lock "cinder-86f265c1-5ac0-4038-a550-8b66f469b2ec-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:41 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2" returned: 0 in 1.053s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1d32a6f-c575-4078-926a-56c70249f2aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:30:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4435e329-dd60-4b33-a6d9-a566b10f258e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:41 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa Jul 05 18:30:41 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:42 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa" returned: 0 in 1.037s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:42 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 Jul 05 18:30:42 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:43 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2" returned: 0 in 0.997s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:43 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2 Jul 05 18:30:43 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:44 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa.493fb558-2a92-4710-9b83-271c0f05c4b2" returned: 0 in 0.758s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-493fb558-2a92-4710-9b83-271c0f05c4b2" released by "_delete_snapshot" :: held 4.007s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.250s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.352s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-836761411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310ec23a-e80a-42b0-8141-bf543fb12681,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a261a732d3174959895b1405a918742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:34Z,use_quota=True,user_id='1c4a199aa7ee407184a236eb4a8e93db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Creating volume 310ec23a-e80a-42b0-8141-bf543fb12681 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:30:44 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa3161f-e27e-4581-9044-d5d2efea9c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55', 'volume_size': 1, 'source_volid': 'b1d32a6f-c575-4078-926a-56c70249f2aa', 'source_volstatus': 'available'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:44 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681 1073741824 Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a0b359-7b12-4371-acfd-25ee48622c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:44 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:44 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Volume volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 (a5abcbd4-56f0-46a0-b7c8-8a3495145d55): created successfully Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a0b359-7b12-4371-acfd-25ee48622c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:44 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (30e977dc-db84-4260-8417-d703ea9d145c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:44 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a5e985a5-57ea-4360-8ac4-7f9c4bdfdc5e tempest-VolumesGetTest-1348204558 None] Created volume successfully. Jul 05 18:30:45 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681 1073741824" returned: 0 in 1.331s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:46 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681 Jul 05 18:30:46 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (2e699a5e-30b8-4198-a6b7-bcf4402bb0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cc50a9-19a6-4867-bed2-b7da8d4dc36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cc50a9-19a6-4867-bed2-b7da8d4dc36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2032191146',display_name='tempest-VolumesGetTest-Volume-1650497087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:46Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7c6456-5966-49c3-9e00-f25b52adac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7c6456-5966-49c3-9e00-f25b52adac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bcd017-3867-4177-8dd8-d52fb6074b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bcd017-3867-4177-8dd8-d52fb6074b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa', 'volume_name': 'volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4092249c-f993-4618-bfb5-a21060f426d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4092249c-f993-4618-bfb5-a21060f426d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9b1a3f-f03a-4671-b57b-0aa8c54f6797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Volume 01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa', 'volume_size': 1} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (914747d2-dda6-4ee0-b9ee-4b49fe67eaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4de54e-e662-4bf5-9388-2488c250f084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4de54e-e662-4bf5-9388-2488c250f084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810706136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:46Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f8d7c7-523c-4d53-9e40-52133fcd4d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5f8d7c7-523c-4d53-9e40-52133fcd4d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f158d14-3c8d-4955-8ac4-a4ab2a2f717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f158d14-3c8d-4955-8ac4-a4ab2a2f717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab', 'volume_name': 'volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c40bddf-1cf1-40f6-982c-8b7efa6e2849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c40bddf-1cf1-40f6-982c-8b7efa6e2849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25c1e76-28f6-4783-9a04-ab01b0a3ebe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Volume 2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab', 'volume_size': 1} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (e4712818-d6a1-449f-a5a5-69e6d43593de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a335e8-97e9-4fea-9250-7ae1f2cfb01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a335e8-97e9-4fea-9250-7ae1f2cfb01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601606479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e922eb-e0e6-4b5e-9fa9-21a614571377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:47Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6a4ebc-12bc-4106-a6c1-623e6bdfcdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6a4ebc-12bc-4106-a6c1-623e6bdfcdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a65a210-b89e-4858-ab9c-e035dceb9c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a65a210-b89e-4858-ab9c-e035dceb9c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62e922eb-e0e6-4b5e-9fa9-21a614571377', 'volume_name': 'volume-62e922eb-e0e6-4b5e-9fa9-21a614571377', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbeb016a-a8fc-4e6b-8d9e-f4a675a4fa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbeb016a-a8fc-4e6b-8d9e-f4a675a4fa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0289f275-3ada-46fb-a7fd-5fe56565accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Volume 62e922eb-e0e6-4b5e-9fa9-21a614571377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62e922eb-e0e6-4b5e-9fa9-21a614571377', 'volume_size': 1} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:47 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681" returned: 0 in 1.059s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] <== create_volume: return (2448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.452s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2032191146',display_name='tempest-VolumesGetTest-Volume-1650497087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:46Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Creating volume 01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:30:47 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:47 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa 1073741824 Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6c401b-47cb-4893-acf1-c61e3b292003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310ec23a-e80a-42b0-8141-bf543fb12681', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92b98aa-fd45-446b-bce7-e1a5663f21c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Volume volume-310ec23a-e80a-42b0-8141-bf543fb12681 (310ec23a-e80a-42b0-8141-bf543fb12681): created successfully Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92b98aa-fd45-446b-bce7-e1a5663f21c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Flow 'volume_create_manager' (5811926e-4de1-4d6f-a6fb-afce0e31b788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-806edd6c-2260-47b7-8865-fb252bacb503 tempest-VolumesListTestJSON-2007687591 None] Created volume successfully. Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (6b9f54e7-410f-4e09-a103-95f50dcdf490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4a9f79-4e93-4226-8953-9e5a41f56867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4a9f79-4e93-4226-8953-9e5a41f56867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1801542499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:47Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd33915-8fa0-4347-883c-1f82579ec0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd33915-8fa0-4347-883c-1f82579ec0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a67c7c-98a9-4b93-a359-5dc1ba415571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a67c7c-98a9-4b93-a359-5dc1ba415571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e', 'volume_name': 'volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e78f019-ae0e-4782-bb86-b8705a44af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e78f019-ae0e-4782-bb86-b8705a44af15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8240bdfe-dcb4-46ae-9a29-ac87c0f93b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Volume f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e', 'volume_size': 1} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (5450c060-d69c-4d28-b603-af69d57f4314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d756aa09-ec0c-4bc2-9e6d-9271f8c7dc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d756aa09-ec0c-4bc2-9e6d-9271f8c7dc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-614365634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:48Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2197b694-8444-4c52-b150-77fc819debf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2197b694-8444-4c52-b150-77fc819debf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed727f3-dc20-420e-8f41-f069ae1cb81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed727f3-dc20-420e-8f41-f069ae1cb81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6', 'volume_name': 'volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab60f367-3552-4a6a-a8d6-33da22b9fc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab60f367-3552-4a6a-a8d6-33da22b9fc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ca1510-3ed1-496b-aed4-e6108210fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:47 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Volume 85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6', 'volume_size': 1} Jul 05 18:30:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (537b3177-60c7-44bb-80df-dc7215998d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bed7dd-ca9c-453f-b015-f150dfa37114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bed7dd-ca9c-453f-b015-f150dfa37114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1450769361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8847f496-26a6-41b7-8c55-a0af79038c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:48Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27df019a-20b3-4023-9000-e41e26f24cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27df019a-20b3-4023-9000-e41e26f24cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63be440e-bca9-403d-b174-3e49403d37ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63be440e-bca9-403d-b174-3e49403d37ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8847f496-26a6-41b7-8c55-a0af79038c70', 'volume_name': 'volume-8847f496-26a6-41b7-8c55-a0af79038c70', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18da581-6650-449f-b45b-a9144dcd2516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18da581-6650-449f-b45b-a9144dcd2516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca6e5c0-e3fc-4753-a4bb-4e9a3d12c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:48 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Volume 8847f496-26a6-41b7-8c55-a0af79038c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8847f496-26a6-41b7-8c55-a0af79038c70', 'volume_size': 1} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:48 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa 1073741824" returned: 0 in 1.305s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:48 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa Jul 05 18:30:48 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Flow 'volume_create_manager' (70c9925d-2a65-4b07-a733-2d956e3f6e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25ed4a3-ccbf-44b7-bd3f-f15b24d414ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25ed4a3-ccbf-44b7-bd3f-f15b24d414ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-933757259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4773b6f9-7af7-4637-84c7-bec7fc9d4234,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a261a732d3174959895b1405a918742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:49Z,use_quota=True,user_id='1c4a199aa7ee407184a236eb4a8e93db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde8b6e5-6525-43e5-83f4-f3cccff53b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde8b6e5-6525-43e5-83f4-f3cccff53b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabb9587-bba3-4e89-8c36-fd876c762f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabb9587-bba3-4e89-8c36-fd876c762f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4773b6f9-7af7-4637-84c7-bec7fc9d4234', 'volume_name': 'volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bae1514-566a-4cfe-900c-be03ebd64249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bae1514-566a-4cfe-900c-be03ebd64249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966af67b-1219-402b-8476-908f3b949e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:49 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Volume 4773b6f9-7af7-4637-84c7-bec7fc9d4234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234', 'volume_size': 1} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:49 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa" returned: 0 in 0.796s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.467s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810706136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:46Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Creating volume 2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:30:49 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:49 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab 1073741824 Jul 05 18:30:49 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9b1a3f-f03a-4671-b57b-0aa8c54f6797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2640c585-08c5-4a9c-b1b7-c8dd431bef0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:49 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Volume volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa (01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa): created successfully Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2640c585-08c5-4a9c-b1b7-c8dd431bef0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (2e699a5e-30b8-4198-a6b7-bcf4402bb0b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:49 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7a6ffcfa-e67b-45ca-b9a1-cc2b20b3e2a4 tempest-VolumesGetTest-1348204558 None] Created volume successfully. Jul 05 18:30:50 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab 1073741824" returned: 0 in 0.956s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:50 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab Jul 05 18:30:50 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Lock "cinder-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-quobyte-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa" acquired by "delete_volume" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:50 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d439976-5a4a-4f65-ae3f-70a691d83efb]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:51 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa Jul 05 18:30:51 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:51 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab" returned: 0 in 0.975s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.244s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601606479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62e922eb-e0e6-4b5e-9fa9-21a614571377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:47Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Creating volume 62e922eb-e0e6-4b5e-9fa9-21a614571377 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:30:51 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:51 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 1073741824 Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25c1e76-28f6-4783-9a04-ab01b0a3ebe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:51 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1b07c8-859f-4188-b60d-c93ec74d8831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:51 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Volume volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab (2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab): created successfully Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1b07c8-859f-4188-b60d-c93ec74d8831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (914747d2-dda6-4ee0-b9ee-4b49fe67eaf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:51 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fa60443e-f0ca-4004-9183-32f5e7521e62 tempest-CreateVolumesFromImageTest-2037637993 None] Created volume successfully. Jul 05 18:30:51 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa" returned: 0 in 0.949s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:51 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa Jul 05 18:30:51 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:52 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 1073741824" returned: 0 in 1.496s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:52 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa" returned: 0 in 0.984s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa" released by "delete_volume" :: held 2.013s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:52 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 Jul 05 18:30:52 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:52 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Created reservations ['f2a102a4-207e-45eb-806f-a24ba0e960e9', 'c571a804-92e9-4fe0-a904-862bf9ebc599', 'e4125474-fca4-4277-80ac-174fd969b8c1', 'd9cad226-a515-4fbf-94dd-0cbf0f1b04fd'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:53 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:30:53 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-a5abcbd4-56f0-46a0-b7c8-8a3495145d55-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Lock "cinder-a5abcbd4-56f0-46a0-b7c8-8a3495145d55-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-quobyte-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0973e1b3-4622-4be4-a9f8-bda7fe5ee7c2]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:53 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 Jul 05 18:30:53 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:54 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377" returned: 0 in 1.209s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] <== create_volume: return (2779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.784s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.662s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1801542499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:47Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Creating volume f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:30:54 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:54 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e 1073741824 Jul 05 18:30:54 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0289f275-3ada-46fb-a7fd-5fe56565accf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62e922eb-e0e6-4b5e-9fa9-21a614571377', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fff3cf-cfeb-49f2-9fae-3a5ef5403c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:54 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Volume volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 (62e922eb-e0e6-4b5e-9fa9-21a614571377): created successfully Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fff3cf-cfeb-49f2-9fae-3a5ef5403c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (e4712818-d6a1-449f-a5a5-69e6d43593de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5d56fc51-2e2c-4cad-963a-0f5d7a3004c4 tempest-CreateVolumesFromImageTest-2037637993 None] Created volume successfully. Jul 05 18:30:54 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.476s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:30:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Deleted volume successfully. Jul 05 18:30:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-28a04141-0790-4eb8-8816-7c25abafc46a tempest-VolumesGetTest-1348204558 None] Lock "cinder-01ee7a71-ea07-4b67-b4e1-93b6e3bb35fa-delete_volume" released by "delete_volume" :: held 3.853s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:55 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" returned: 0 in 1.517s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:55 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55 Jul 05 18:30:55 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:55 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e 1073741824" returned: 0 in 1.300s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:55 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e Jul 05 18:30:55 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:55 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" returned: 0 in 0.925s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-a5abcbd4-56f0-46a0-b7c8-8a3495145d55" released by "delete_volume" :: held 2.513s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Created reservations ['a5e04e16-b31d-449f-b6ff-2709331ef22d', '417bbeb0-1ce5-42ff-abaf-2cb27fcbc652', 'cd796f33-9bbe-41f0-b514-8122b05a327b', '46dbdab8-4f06-429d-a2f5-f8e5666958f4'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:56 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:30:56 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:56 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e" returned: 0 in 1.140s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] <== create_volume: return (2508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.665s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-614365634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:48Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Creating volume 85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:30:56 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:56 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 1073741824 Jul 05 18:30:56 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8240bdfe-dcb4-46ae-9a29-ac87c0f93b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acf4a92-e22d-4f0c-84ff-0e956b061ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Volume volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e (f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e): created successfully Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acf4a92-e22d-4f0c-84ff-0e956b061ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (6b9f54e7-410f-4e09-a103-95f50dcdf490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ea4244cf-84aa-4fd0-b0f3-93654195375b tempest-CreateVolumesFromImageTest-2037637993 None] Created volume successfully. Jul 05 18:30:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-b1d32a6f-c575-4078-926a-56c70249f2aa-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Lock "cinder-b1d32a6f-c575-4078-926a-56c70249f2aa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-quobyte-b1d32a6f-c575-4078-926a-56c70249f2aa" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-b1d32a6f-c575-4078-926a-56c70249f2aa" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:30:57 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.007s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[216e6243-e561-4757-84a1-94749ed9c2ac]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Deleted volume successfully. Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d2aac504-1bda-4d92-ab98-2a4e1f114862 tempest-VolumesGetTest-1348204558 None] Lock "cinder-a5abcbd4-56f0-46a0-b7c8-8a3495145d55-delete_volume" released by "delete_volume" :: held 4.023s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:57 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa Jul 05 18:30:57 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (09a9a2fc-3b97-40c3-9ed2-48d33544e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01208cd-0558-4e97-80f0-238d54205848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01208cd-0558-4e97-80f0-238d54205848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-873381138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d57173-7db1-45aa-ba03-bf1b3164db51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bc075a603345419b5f32d50c6da096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:58Z,use_quota=True,user_id='b346f876d9e34b4e8583de5a8defbd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bafb06-0f67-4632-8528-053bfc7039a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bafb06-0f67-4632-8528-053bfc7039a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ca1cea-824c-4734-95a1-babb30843078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:57 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ca1cea-824c-4734-95a1-babb30843078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73d57173-7db1-45aa-ba03-bf1b3164db51', 'volume_name': 'volume-73d57173-7db1-45aa-ba03-bf1b3164db51', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2d86da-ef86-4400-9acf-639be97ac37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2d86da-ef86-4400-9acf-639be97ac37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d84835-a337-4b89-868a-f7b2aaa9c2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:57 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Volume 73d57173-7db1-45aa-ba03-bf1b3164db51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73d57173-7db1-45aa-ba03-bf1b3164db51', 'volume_size': 1} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 1073741824" returned: 0 in 1.235s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:57 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 Jul 05 18:30:57 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:58 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa" returned: 0 in 0.947s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:58 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa Jul 05 18:30:58 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:58 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6" returned: 0 in 0.741s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.301s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1450769361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8847f496-26a6-41b7-8c55-a0af79038c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07b936ff322647f88ba14008a1e5b8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:48Z,use_quota=True,user_id='23e46ee1113a40ec89b4728df5f95b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Creating volume 8847f496-26a6-41b7-8c55-a0af79038c70 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:30:58 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:58 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70 1073741824 Jul 05 18:30:58 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ca1510-3ed1-496b-aed4-e6108210fb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc5a74c-101a-4380-a011-93587da1b002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:30:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Volume volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 (85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6): created successfully Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc5a74c-101a-4380-a011-93587da1b002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (5450c060-d69c-4d28-b603-af69d57f4314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:30:58 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7e4b6b58-72a0-4a05-b1b2-0b8ad02bae0a tempest-CreateVolumesFromImageTest-2037637993 None] Created volume successfully. Jul 05 18:30:58 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b1d32a6f-c575-4078-926a-56c70249f2aa" returned: 0 in 0.702s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-b1d32a6f-c575-4078-926a-56c70249f2aa" released by "delete_volume" :: held 1.748s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Created reservations ['78c19ef9-d9a4-4ac7-958c-5f8ebd97f2ca', 'ea6f0958-3793-4b5c-bfb4-79f8fd3533f5', 'a6191937-1168-4dd1-931a-fb22ac75e7ad', '811b07c2-41d7-47c9-9c87-f1268faf5ca0'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:59 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:30:59 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:59 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70 1073741824" returned: 0 in 1.096s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:30:59 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70 Jul 05 18:30:59 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:30:59 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.807s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:30:59 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:30:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Deleted volume successfully. Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c2fedf37-ed6a-492b-b3c7-2a1852b1070c tempest-VolumesGetTest-1348204558 None] Lock "cinder-b1d32a6f-c575-4078-926a-56c70249f2aa-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (fef1f0b7-05c5-408a-9ec1-0a6bd356dc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31184a1-8e9c-4d2d-9935-5d2e71df30b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31184a1-8e9c-4d2d-9935-5d2e71df30b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-350204664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8a8b5d-0cc3-4535-8134-56856fbdf93e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:00Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86bfcea-fb23-49e2-823c-658dc531360e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86bfcea-fb23-49e2-823c-658dc531360e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6357cd85-c1cc-43d5-a4b1-2ee1796fd367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.image.glance [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Creating Keystone auth plugin from conf {{(pid=86664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 18:31:00 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70" returned: 0 in 0.783s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.389s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-933757259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4773b6f9-7af7-4637-84c7-bec7fc9d4234,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a261a732d3174959895b1405a918742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:49Z,use_quota=True,user_id='1c4a199aa7ee407184a236eb4a8e93db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Creating volume 4773b6f9-7af7-4637-84c7-bec7fc9d4234 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:00 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:00 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 1073741824 Jul 05 18:31:00 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca6e5c0-e3fc-4753-a4bb-4e9a3d12c697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8847f496-26a6-41b7-8c55-a0af79038c70', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b51d30-af73-46bd-a247-3a81544cf812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6357cd85-c1cc-43d5-a4b1-2ee1796fd367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a8a8b5d-0cc3-4535-8134-56856fbdf93e', 'volume_name': 'volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c6f19b-8d1a-4e36-9085-a3084b924d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c6f19b-8d1a-4e36-9085-a3084b924d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414208e0-2b00-49d3-b39f-1ded709a8235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:00 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Volume 0a8a8b5d-0cc3-4535-8134-56856fbdf93e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Trying to clone 0a8a8b5d-0cc3-4535-8134-56856fbdf93e from image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]). {{(pid=86664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 18:31:00 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Volume volume-8847f496-26a6-41b7-8c55-a0af79038c70 (8847f496-26a6-41b7-8c55-a0af79038c70): created successfully Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b51d30-af73-46bd-a247-3a81544cf812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:00 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Flow 'volume_create_manager' (537b3177-60c7-44bb-80df-dc7215998d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:00 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-887493bb-1f0c-4bd1-8384-8991c693e2af tempest-CreateVolumesFromImageTest-2037637993 None] Created volume successfully. Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 18:31:01 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Image download 20.69 MB at 20.69 MB/s Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4161655-ebc5-48e5-af85-e789c691a653]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:01 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD Jul 05 18:31:01 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:01 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 1073741824" returned: 0 in 0.997s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:01 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 Jul 05 18:31:01 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-8847f496-26a6-41b7-8c55-a0af79038c70-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-8847f496-26a6-41b7-8c55-a0af79038c70-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-quobyte-8847f496-26a6-41b7-8c55-a0af79038c70" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-8847f496-26a6-41b7-8c55-a0af79038c70" acquired by "delete_volume" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ae3c6f-6895-489c-9319-5db9f7e5bbc6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:02 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70 Jul 05 18:31:02 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:02 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD" returned: 0 in 0.895s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Temporary image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 is fetched for user d91c8b11597d4165a594952f72722383. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9184eeb-63ea-41d7-b2df-a9e3ca2ed65d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:02 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD Jul 05 18:31:02 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:02 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234" returned: 0 in 0.870s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.685s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-873381138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d57173-7db1-45aa-ba03-bf1b3164db51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bc075a603345419b5f32d50c6da096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:30:58Z,use_quota=True,user_id='b346f876d9e34b4e8583de5a8defbd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Creating volume 73d57173-7db1-45aa-ba03-bf1b3164db51 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:02 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:02 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 1073741824 Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966af67b-1219-402b-8476-908f3b949e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:02 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b00e6ee-0b1f-400a-81d9-2a76f7938f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:02 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Volume volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 (4773b6f9-7af7-4637-84c7-bec7fc9d4234): created successfully Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b00e6ee-0b1f-400a-81d9-2a76f7938f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Flow 'volume_create_manager' (70c9925d-2a65-4b07-a733-2d956e3f6e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c80061d9-77d6-4dc3-931f-1401c6b11a91 tempest-VolumesListTestJSON-2007687591 None] Created volume successfully. Jul 05 18:31:02 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70" returned: 0 in 0.952s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:02 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70 Jul 05 18:31:02 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:03 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD" returned: 0 in 0.898s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:03 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 1073741824" returned: 0 in 1.180s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:03 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 Jul 05 18:31:03 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:03 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8847f496-26a6-41b7-8c55-a0af79038c70" returned: 0 in 0.895s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-8847f496-26a6-41b7-8c55-a0af79038c70" released by "delete_volume" :: held 1.933s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:03 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Created reservations ['e68b3d8c-f845-4140-bd73-06c02b130be7', 'aa709aaa-2cbb-44a4-9f12-e3b89dfc855f', '0cd96770-e836-499d-a43c-5fe2476cd7da', 'aba45bd9-587e-47dd-9b46-3033b82f177f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:04 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:04 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Flow 'volume_create_manager' (47e4a277-8602-49e8-ae22-eda20fd4e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5b7192-6ac4-420f-a639-0fce99a7e50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5b7192-6ac4-420f-a639-0fce99a7e50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2075462027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd19d71-59d6-4f95-89a1-6f25662f19d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a261a732d3174959895b1405a918742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:04Z,use_quota=True,user_id='1c4a199aa7ee407184a236eb4a8e93db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a389a3d3-6824-4224-a14e-84f94e23d0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a389a3d3-6824-4224-a14e-84f94e23d0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a394aa32-bb29-467b-9033-5ad5a3a501f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a394aa32-bb29-467b-9033-5ad5a3a501f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd19d71-59d6-4f95-89a1-6f25662f19d3', 'volume_name': 'volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624a163d-3518-4095-b270-3deada189907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624a163d-3518-4095-b270-3deada189907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bffead-09b8-478a-8652-18485af94f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Volume 7bd19d71-59d6-4f95-89a1-6f25662f19d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3', 'volume_size': 1} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-quobyte-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d4c4b4-1f77-4ae8-9b43-6c36e0c5a97a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:04 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 Jul 05 18:31:04 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:04 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51" returned: 0 in 0.882s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-350204664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a8a8b5d-0cc3-4535-8134-56856fbdf93e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:00Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Creating volume 0a8a8b5d-0cc3-4535-8134-56856fbdf93e {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:04 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d84835-a337-4b89-868a-f7b2aaa9c2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d57173-7db1-45aa-ba03-bf1b3164db51', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:04 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e 1073741824 Jul 05 18:31:04 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0987beaf-c76a-4896-a895-c7f5b223ba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Volume volume-73d57173-7db1-45aa-ba03-bf1b3164db51 (73d57173-7db1-45aa-ba03-bf1b3164db51): created successfully Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0987beaf-c76a-4896-a895-c7f5b223ba9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (09a9a2fc-3b97-40c3-9ed2-48d33544e601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-cc02eeb3-4e49-481d-aa92-edd80e0c8a3b tempest-VolumesSnapshotTestJSON-1886162574 None] Created volume successfully. Jul 05 18:31:04 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.806s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Deleted volume successfully. Jul 05 18:31:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5033a8a6-c14d-4b17-9f3b-9421efdf6d79 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-8847f496-26a6-41b7-8c55-a0af79038c70-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:05 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6" returned: 0 in 1.080s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:05 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6 Jul 05 18:31:05 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:05 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e 1073741824" returned: 0 in 1.074s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:05 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e Jul 05 18:31:05 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:06 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6" returned: 0 in 0.736s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6" released by "delete_volume" :: held 1.877s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Created reservations ['0578a419-a71c-47df-9fcb-c88d9c6f69cb', '4e2b880b-cb27-40a8-8478-9ddbeb0f6ad1', 'a1b5415c-2d31-4c4e-b8b0-d28d702aae03', 'ab105d29-f125-4f70-9b0b-5b5ee1a2ae5a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:06 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:06 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-quobyte-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f7d939-2681-4154-afe1-2e79c66d0fc2]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:06 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" returned: 0 in 0.958s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.344s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2075462027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd19d71-59d6-4f95-89a1-6f25662f19d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a261a732d3174959895b1405a918742e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:04Z,use_quota=True,user_id='1c4a199aa7ee407184a236eb4a8e93db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Creating volume 7bd19d71-59d6-4f95-89a1-6f25662f19d3 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:06 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:06 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e Jul 05 18:31:06 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:06 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 1073741824 Jul 05 18:31:06 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Attempting download of 8ef91c9d-cbe2-449c-b464-74cfa5f50992 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}])) to volume 0a8a8b5d-0cc3-4535-8134-56856fbdf93e. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaef34b9-1f67-43f8-a29c-610fe94dab93]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_qf7o9z17 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:06 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_qf7o9z17 Jul 05 18:31:06 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:07 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.828s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:07 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Deleted volume successfully. Jul 05 18:31:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ebae0dff-0729-4351-a5e1-d239225fbb6a tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-85fe5ebd-cc8a-44cd-b19d-0b81a4a3edc6-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:07 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e" returned: 0 in 0.906s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:07 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e Jul 05 18:31:07 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:07 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 1073741824" returned: 0 in 1.049s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:07 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_qf7o9z17" returned: 0 in 0.981s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_qf7o9z17 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:07 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 Jul 05 18:31:07 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:07 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_qf7o9z17 Jul 05 18:31:07 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:08 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e" returned: 0 in 0.737s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e" released by "delete_volume" :: held 1.699s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Created reservations ['9eeae1f1-d500-43cb-afa1-f13de63d727e', 'e6f8bea2-3a34-49a1-8b81-f3421d6ce2d5', 'be1d04d1-9f14-49c9-b8ce-007acf5e3942', 'be154695-ba67-41c5-a5de-cbed183d83e5'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:08 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:08 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:08 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3" returned: 0 in 0.858s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.030s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bffead-09b8-478a-8652-18485af94f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb48f229-e038-44af-8cb9-6b5936d2fd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Creating offline snapshot 42c8dc88-b74d-468c-8d12-87aec012dbb0 of volume 73d57173-7db1-45aa-ba03-bf1b3164db51 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:31:08 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_qf7o9z17" returned: 1 in 0.952s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_qf7o9z17' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed82d23d-72be-421a-9e47-7cf09431cdcf]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[609a8a33-a25c-47aa-bdc3-977d552b3368]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:08 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Volume volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 (7bd19d71-59d6-4f95-89a1-6f25662f19d3): created successfully Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb48f229-e038-44af-8cb9-6b5936d2fd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Flow 'volume_create_manager' (47e4a277-8602-49e8-ae22-eda20fd4e263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-62e922eb-e0e6-4b5e-9fa9-21a614571377-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:08 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8ad9281e-6989-4277-b64c-f736b16e0720 tempest-VolumesListTestJSON-2007687591 None] Created volume successfully. Jul 05 18:31:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-62e922eb-e0e6-4b5e-9fa9-21a614571377-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:08 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 Jul 05 18:31:09 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-quobyte-62e922eb-e0e6-4b5e-9fa9-21a614571377" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-62e922eb-e0e6-4b5e-9fa9-21a614571377" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a712c52-f712-4191-9c1d-4012f396709a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:09 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD Jul 05 18:31:09 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:09 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 Jul 05 18:31:09 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:09 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.049s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:09 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Deleted volume successfully. Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-774fa5c4-14ae-4599-ba50-4dd6fa419b40 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-f4a4c2ab-6d40-4cca-8f03-d9a8ad5b650e-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:09 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD" returned: 0 in 1.053s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] 8ef91c9d-cbe2-449c-b464-74cfa5f50992 was qcow2, converting to raw {{(pid=86664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:09 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51" returned: 0 in 1.045s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:09 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e Jul 05 18:31:09 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:09 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 1G Jul 05 18:31:09 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:10 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377" returned: 0 in 1.297s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:10 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377 Jul 05 18:31:10 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:11 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 1G" returned: 0 in 1.138s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73d57173-7db1-45aa-ba03-bf1b3164db51 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:11 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73d57173-7db1-45aa-ba03-bf1b3164db51 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 Jul 05 18:31:11 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:11 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-62e922eb-e0e6-4b5e-9fa9-21a614571377" returned: 0 in 1.054s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-62e922eb-e0e6-4b5e-9fa9-21a614571377" released by "delete_volume" :: held 2.408s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Created reservations ['a60da69c-910b-49d9-ba62-758f4fbcd8be', '118aaf7d-f382-404b-9e73-3123cbb13c83', '44574df1-25ad-4cfd-85c5-eeba030e9847', '2a8918f3-4d46-4af3-b14e-bd1dc936ff64'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:11 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:11 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:12 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:12 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:12 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73d57173-7db1-45aa-ba03-bf1b3164db51 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0" returned: 0 in 1.233s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:12 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 is being set with open permissions: ugo+rw Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:12 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 Jul 05 18:31:12 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "cinder-quobyte-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab" acquired by "delete_volume" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[022cf62e-6e9b-44a3-bb1b-b47d4877a00b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:12 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:12 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" returned: 0 in 3.052s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_g_bnfl0xdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:31:12 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Converted 112.00 MB image at 36.68 MB/s Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:12 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab Jul 05 18:31:12 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.276s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:12 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Deleted volume successfully. Jul 05 18:31:12 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e 1G Jul 05 18:31:12 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8526e47b-c702-4743-9177-c8980ee84796 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-62e922eb-e0e6-4b5e-9fa9-21a614571377-delete_volume" released by "delete_volume" :: held 4.088s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "cinder-7bd19d71-59d6-4f95-89a1-6f25662f19d3-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-7bd19d71-59d6-4f95-89a1-6f25662f19d3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "cinder-quobyte-7bd19d71-59d6-4f95-89a1-6f25662f19d3" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-quobyte-7bd19d71-59d6-4f95-89a1-6f25662f19d3" acquired by "delete_volume" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edda158-d980-4a27-ae79-42219bec2985]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:13 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0" returned: 0 in 1.032s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:13 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 Jul 05 18:31:13 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:13 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.info Jul 05 18:31:13 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:13 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.342s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:31:13 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e 1G" returned: 0 in 1.049s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:13 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab" returned: 0 in 1.222s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a968f4-c035-448a-9ac3-841470317ec8]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:14 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab Jul 05 18:31:14 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:14 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.info" returned: 0 in 0.793s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:14 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.info is being set with open permissions: ugo+rw Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:14 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e Jul 05 18:31:14 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:14 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.info Jul 05 18:31:14 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:14 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3" returned: 0 in 1.170s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:14 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3 Jul 05 18:31:14 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:14 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.info" returned: 0 in 0.691s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:14 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.127s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=139,cinder:SELECT=93,cinder:INSERT=31,cinder:DELETE=14 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab" returned: 0 in 0.858s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-quobyte-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab" released by "delete_volume" :: held 2.166s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=129,cinder:SELECT=95,cinder:INSERT=40,cinder:DELETE=10 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:31:14 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-bc831c9e-520c-420f-8d7c-3f4f3103c367 tempest-VolumesSnapshotTestJSON-1886162574 None] Create snapshot completed successfully Jul 05 18:31:14 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Created reservations ['e32c07b4-b1ea-4c9e-8879-f01b7b51e6de', 'b657f69f-7895-46f7-b7d6-c1b661ad1871', '764b91f0-cf69-42a9-a338-bab7af7cbbea', '94b12255-064f-46d9-b716-efe679c504ea'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:15 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" returned: 0 in 1.019s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:15 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:15 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:15 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e Jul 05 18:31:15 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:15 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7bd19d71-59d6-4f95-89a1-6f25662f19d3" returned: 0 in 0.848s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-quobyte-7bd19d71-59d6-4f95-89a1-6f25662f19d3" released by "delete_volume" :: held 2.069s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Created reservations ['eea048de-4cd6-4f6d-ae2d-a42828616236', '0546a59f-557b-46a9-a355-9b4d99f6d8f4', 'ca47f728-2f72-4bc2-90fc-e21d3ef15724', '0a161c0b-0d9c-4861-8ec3-018c2885961d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:15 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:15 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "cinder-4773b6f9-7af7-4637-84c7-bec7fc9d4234-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-4773b6f9-7af7-4637-84c7-bec7fc9d4234-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "cinder-quobyte-4773b6f9-7af7-4637-84c7-bec7fc9d4234" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-quobyte-4773b6f9-7af7-4637-84c7-bec7fc9d4234" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[208e206c-fc56-41d2-a838-b215ead54f8f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-42c8dc88-b74d-468c-8d12-87aec012dbb0-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-42c8dc88-b74d-468c-8d12-87aec012dbb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-73d57173-7db1-45aa-ba03-bf1b3164db51" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-73d57173-7db1-45aa-ba03-bf1b3164db51" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-42c8dc88-b74d-468c-8d12-87aec012dbb0" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:15 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-42c8dc88-b74d-468c-8d12-87aec012dbb0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:15 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Deleting offline snapshot 42c8dc88-b74d-468c-8d12-87aec012dbb0 of volume 73d57173-7db1-45aa-ba03-bf1b3164db51 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] snapshot_file for this snap is: volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1eba31-0c92-4dae-809b-4572c39b1f2b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:16 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.991s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Deleted volume successfully. Jul 05 18:31:16 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-02de375a-075a-412a-89d1-1ad81e862007 tempest-CreateVolumesFromImageTest-2037637993 None] Lock "cinder-2d7f2b3b-e0aa-4b7f-8a50-8a7e5f0c29ab-delete_volume" released by "delete_volume" :: held 3.534s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" returned: 1 in 1.119s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Downloaded image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}])) to volume 0a8a8b5d-0cc3-4535-8134-56856fbdf93e successfully. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Temporary image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 for user d91c8b11597d4165a594952f72722383 is deleted. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Marking volume 0a8a8b5d-0cc3-4535-8134-56856fbdf93e as bootable. {{(pid=86664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Copying metadata from image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 to 0a8a8b5d-0cc3-4535-8134-56856fbdf93e. {{(pid=86664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Creating volume glance metadata for volume 0a8a8b5d-0cc3-4535-8134-56856fbdf93e backed by image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 18:31:16 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 Jul 05 18:31:16 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (414208e0-2b00-49d3-b39f-1ded709a8235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f88f0f-ff3d-4f30-bfd3-40e4bdae9703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:16 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Volume volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e (0a8a8b5d-0cc3-4535-8134-56856fbdf93e): created successfully Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f88f0f-ff3d-4f30-bfd3-40e4bdae9703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (fef1f0b7-05c5-408a-9ec1-0a6bd356dc50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-efe03688-7491-44ab-a41e-13a8bd53b78b tempest-VolumesGetTest-1348204558 None] Created volume successfully. Jul 05 18:31:16 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.126s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Deleted volume successfully. Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c12610b5-d50d-4289-aaf0-f08e0035f8b5 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-7bd19d71-59d6-4f95-89a1-6f25662f19d3-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:16 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234" returned: 0 in 1.195s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:17 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234 Jul 05 18:31:17 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:17 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0" returned: 0 in 1.031s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73d57173-7db1-45aa-ba03-bf1b3164db51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[483b3db0-1121-418c-823d-ea0739401f6b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:17 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 Jul 05 18:31:17 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:17 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4773b6f9-7af7-4637-84c7-bec7fc9d4234" returned: 0 in 0.816s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-quobyte-4773b6f9-7af7-4637-84c7-bec7fc9d4234" released by "delete_volume" :: held 2.084s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (ed332051-e550-49f8-9195-bbe7355d31ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021547b5-f05b-4d91-bcb6-562ace31e042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021547b5-f05b-4d91-bcb6-562ace31e042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1255621197',display_name='tempest-VolumesGetTest-Volume-1800344811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85573fbb-eca3-4568-a7d9-f7776246422e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:18Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16d78a1-a3f9-41fc-9980-6b6c651f7c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16d78a1-a3f9-41fc-9980-6b6c651f7c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac42a8b-5efc-4fce-a3d1-ab2a2eaaa3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac42a8b-5efc-4fce-a3d1-ab2a2eaaa3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85573fbb-eca3-4568-a7d9-f7776246422e', 'volume_name': 'volume-85573fbb-eca3-4568-a7d9-f7776246422e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5c9eba-f598-45fb-839c-2bfa6d615dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5c9eba-f598-45fb-839c-2bfa6d615dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7b64d6-c07f-4a71-b8e6-3bddaab0b319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:18 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Volume 85573fbb-eca3-4568-a7d9-f7776246422e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85573fbb-eca3-4568-a7d9-f7776246422e', 'volume_size': 1} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1255621197',display_name='tempest-VolumesGetTest-Volume-1800344811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85573fbb-eca3-4568-a7d9-f7776246422e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4e8c3da42241658ac2913dd784a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:18Z,use_quota=True,user_id='d91c8b11597d4165a594952f72722383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Creating volume 85573fbb-eca3-4568-a7d9-f7776246422e {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:18 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Created reservations ['fa634c10-46b5-4548-9ad7-d9e218898e5a', 'c41d93bd-7f72-4380-98dc-184c44a7793a', 'b96e5bbb-0aa0-43b0-a22c-769cc65a15c8', 'a7b5fb20-e474-4288-8194-64cea6571f6d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:18 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e 1073741824 Jul 05 18:31:18 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:18 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:18 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:18 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51" returned: 0 in 1.212s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:18 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 Jul 05 18:31:18 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:18 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.819s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:18 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:18 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Deleted volume successfully. Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a161bc93-5e6d-45b5-95d8-9a483820dd81 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-4773b6f9-7af7-4637-84c7-bec7fc9d4234-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "cinder-310ec23a-e80a-42b0-8141-bf543fb12681-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-310ec23a-e80a-42b0-8141-bf543fb12681-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "cinder-quobyte-310ec23a-e80a-42b0-8141-bf543fb12681" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-quobyte-310ec23a-e80a-42b0-8141-bf543fb12681" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:19 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e 1073741824" returned: 0 in 1.245s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[56537033-7348-4d6a-bae9-512ba047705f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:19 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e Jul 05 18:31:19 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:19 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0" returned: 0 in 1.075s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:19 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681 Jul 05 18:31:19 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:19 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0 Jul 05 18:31:19 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:20 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e" returned: 0 in 0.829s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7b64d6-c07f-4a71-b8e6-3bddaab0b319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85573fbb-eca3-4568-a7d9-f7776246422e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d566e28d-1317-4b2f-b0d3-ccbd07a68cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:20 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51.42c8dc88-b74d-468c-8d12-87aec012dbb0" returned: 0 in 0.796s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:20 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Volume volume-85573fbb-eca3-4568-a7d9-f7776246422e (85573fbb-eca3-4568-a7d9-f7776246422e): created successfully Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d566e28d-1317-4b2f-b0d3-ccbd07a68cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Flow 'volume_create_manager' (ed332051-e550-49f8-9195-bbe7355d31ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:20 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681" returned: 0 in 0.972s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-42c8dc88-b74d-468c-8d12-87aec012dbb0" released by "_delete_snapshot" :: held 4.316s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-42b9e390-da4e-4977-8cbb-c09e3bd308de tempest-VolumesGetTest-1348204558 None] Created volume successfully. Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-73d57173-7db1-45aa-ba03-bf1b3164db51" released by "delete_snapshot" :: held 4.363s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:20 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681 Jul 05 18:31:20 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Created reservations ['5cfb96a0-6eca-4223-b629-9e97400f4b11', '9f0d372c-e0b7-42eb-9efd-a3bbd6cbcde1', '60497475-6b05-4a78-ab69-6cc569732bb3', '8ea9ad0c-96e2-4967-9365-6ff381f0c9b2'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Delete snapshot completed successfully. Jul 05 18:31:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dafdc208-a4be-4c66-83ad-fb949161e8d4 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-42c8dc88-b74d-468c-8d12-87aec012dbb0-delete_snapshot" released by "delete_snapshot" :: held 4.617s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:21 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-310ec23a-e80a-42b0-8141-bf543fb12681" returned: 0 in 0.727s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-quobyte-310ec23a-e80a-42b0-8141-bf543fb12681" released by "delete_volume" :: held 1.758s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Created reservations ['da0f13ec-f271-4b60-b681-e4544d222b02', '2b1ef06e-ccc7-45f5-96ed-4354afa266a4', '01716f21-3bed-4cf7-8d9e-fe611c5d9eba', '6fd52c2e-3f04-4762-beeb-ff557240645d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-85573fbb-eca3-4568-a7d9-f7776246422e-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:21 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:21 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Lock "cinder-85573fbb-eca3-4568-a7d9-f7776246422e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-quobyte-85573fbb-eca3-4568-a7d9-f7776246422e" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-85573fbb-eca3-4568-a7d9-f7776246422e" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a774a3-315d-4d72-9591-c141b2676abf]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:21 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e Jul 05 18:31:21 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:31:22 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (607cac5d-7f7f-4d72-8eeb-c1b08e875887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90551a05-56a9-43e9-bab0-4f35afae2807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.098s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90551a05-56a9-43e9-bab0-4f35afae2807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545195864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06bd76e2-7bff-4da3-ab72-0b293ad51fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bc075a603345419b5f32d50c6da096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:22Z,use_quota=True,user_id='b346f876d9e34b4e8583de5a8defbd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a399ba-5672-4469-9b89-3668042e343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a399ba-5672-4469-9b89-3668042e343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c9aacf-8642-4ae1-bb5c-e23e0e5c4df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c9aacf-8642-4ae1-bb5c-e23e0e5c4df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06bd76e2-7bff-4da3-ab72-0b293ad51fc9', 'volume_name': 'volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd3a390-cf13-4612-b83c-eaf645907708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd3a390-cf13-4612-b83c-eaf645907708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c261f3-08be-48f7-abb1-ab1fe4025a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:22 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Volume 06bd76e2-7bff-4da3-ab72-0b293ad51fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9', 'volume_size': 1} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545195864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06bd76e2-7bff-4da3-ab72-0b293ad51fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bc075a603345419b5f32d50c6da096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:22Z,use_quota=True,user_id='b346f876d9e34b4e8583de5a8defbd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Creating volume 06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:22 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Deleted volume successfully. Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e79d5db9-375f-4de4-8553-d965e5407ad3 tempest-VolumesListTestJSON-2007687591 None] Lock "cinder-310ec23a-e80a-42b0-8141-bf543fb12681-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:22 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 1073741824 Jul 05 18:31:22 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e" returned: 0 in 1.403s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:22 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:22 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e Jul 05 18:31:22 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:23 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85573fbb-eca3-4568-a7d9-f7776246422e" returned: 0 in 0.940s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-85573fbb-eca3-4568-a7d9-f7776246422e" released by "delete_volume" :: held 2.410s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:23 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 1073741824" returned: 0 in 1.491s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:23 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Created reservations ['16027ddc-2ac5-474c-8bd5-8d1a95758215', '67100e01-74ae-4477-b072-075eaad21f5e', 'f1a9eb8b-dd70-47fd-9621-34d15c0db4e5', '55c832bb-ce13-40af-8046-19b9cffc5334'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:23 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 Jul 05 18:31:23 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:24 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:24 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-0a8a8b5d-0cc3-4535-8134-56856fbdf93e-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Lock "cinder-0a8a8b5d-0cc3-4535-8134-56856fbdf93e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:24 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" returned: 0 in 0.881s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] <== create_volume: return (2458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.464s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c261f3-08be-48f7-abb1-ab1fe4025a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6bfe4d-bf78-473f-b8b9-7efb5222a947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Acquiring lock "cinder-quobyte-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:24 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Volume volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 (06bd76e2-7bff-4da3-ab72-0b293ad51fc9): created successfully Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6bfe4d-bf78-473f-b8b9-7efb5222a947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (607cac5d-7f7f-4d72-8eeb-c1b08e875887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:24 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ae77c112-f8c9-4f18-87c9-d574a596f1fa tempest-VolumesSnapshotTestJSON-1886162574 None] Created volume successfully. Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d74cb99-c617-46de-95a6-bbdddfdcde31]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:25 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e Jul 05 18:31:25 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:25 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.120s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Deleted volume successfully. Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8f28d126-a72f-4139-8d8e-72a6e926cd80 tempest-VolumesGetTest-1348204558 None] Lock "cinder-85573fbb-eca3-4568-a7d9-f7776246422e-delete_volume" released by "delete_volume" :: held 4.030s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Creating offline snapshot b18da723-4706-48f8-974d-6dec627373a5 of volume 06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d49d8b-c1a5-427d-9558-257d11a8de82]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:26 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 Jul 05 18:31:26 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:26 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" returned: 0 in 1.127s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:26 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e Jul 05 18:31:26 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Flow 'volume_create_manager' (cdfeaee4-459e-4f9d-87e3-aed18518fc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc60e74-d4fe-42b0-802c-d93f546d6407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc60e74-d4fe-42b0-802c-d93f546d6407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1902376920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a7c8a4-8b8f-48e7-a717-bc5e91923b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8d79e11bf54f5cb963eeb74cba8d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:27Z,use_quota=True,user_id='42ed96def825431193eaec9f60341fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56488eff-ce62-4a1c-b4d5-108df833ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56488eff-ce62-4a1c-b4d5-108df833ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee48cb9-5f6d-45f2-a3df-d0d88c98d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee48cb9-5f6d-45f2-a3df-d0d88c98d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a7c8a4-8b8f-48e7-a717-bc5e91923b21', 'volume_name': 'volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21', 'volume_size': 2}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2028889-7be6-4ba5-a75d-67ef6d76727c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2028889-7be6-4ba5-a75d-67ef6d76727c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1e279f-08e8-4f3b-9642-21ff2b43a689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:26 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Volume 21a7c8a4-8b8f-48e7-a717-bc5e91923b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21', 'volume_size': 2} Jul 05 18:31:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:27 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" returned: 0 in 1.168s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:27 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 1G Jul 05 18:31:27 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:27 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" returned: 1 in 1.104s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:31:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:27 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e Jul 05 18:31:27 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:28 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 1G" returned: 0 in 0.993s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:28 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 Jul 05 18:31:28 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:28 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" returned: 0 in 0.903s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Lock "cinder-quobyte-0a8a8b5d-0cc3-4535-8134-56856fbdf93e" released by "delete_volume" :: held 3.257s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Created reservations ['089cee47-0f6b-4c2f-9b39-380523148b6e', '53a5191a-f406-40e9-b32e-7cfa8c61aff4', '63881882-e32b-4c6a-a77e-168cbdf3911e', '9791e658-1763-49bc-b255-06c192443eb9'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:28 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:28 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:29 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5" returned: 0 in 0.957s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:29 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 is being set with open permissions: ugo+rw Jul 05 18:31:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:29 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 Jul 05 18:31:29 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:29 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.827s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:29 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Deleted volume successfully. Jul 05 18:31:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-66982630-6779-416f-869e-0ba0b57e4905 tempest-VolumesGetTest-1348204558 None] Lock "cinder-0a8a8b5d-0cc3-4535-8134-56856fbdf93e-delete_volume" released by "delete_volume" :: held 4.444s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:29 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5" returned: 0 in 0.804s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:29 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.info Jul 05 18:31:29 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:30 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.info" returned: 0 in 0.777s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:30 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.info is being set with open permissions: ugo+rw Jul 05 18:31:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:30 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.info Jul 05 18:31:30 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:31 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.info" returned: 0 in 0.859s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.699s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.653s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1902376920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a7c8a4-8b8f-48e7-a717-bc5e91923b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8d79e11bf54f5cb963eeb74cba8d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:27Z,use_quota=True,user_id='42ed96def825431193eaec9f60341fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Creating volume 21a7c8a4-8b8f-48e7-a717-bc5e91923b21 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:31 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:31:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 2147483648 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:31 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 2147483648 Jul 05 18:31:31 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:31 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f20d3574-b86f-4d7f-85c7-bf34f08c8c72 tempest-VolumesSnapshotTestJSON-1886162574 None] Create snapshot completed successfully Jul 05 18:31:32 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 2147483648" returned: 0 in 1.141s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:32 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 Jul 05 18:31:32 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:32 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (23b461b5-cf88-47b5-a9a5-be4f5ca106ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adc699f-8a89-4e2e-b102-a7b499ad6e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adc699f-8a89-4e2e-b102-a7b499ad6e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-865576319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bc68ce-8ca5-49d0-bd95-fbaa84884b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bc075a603345419b5f32d50c6da096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b18da723-4706-48f8-974d-6dec627373a5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:33Z,use_quota=True,user_id='b346f876d9e34b4e8583de5a8defbd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbdfb17-2c91-46bd-93fa-724c26fc57ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbdfb17-2c91-46bd-93fa-724c26fc57ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01ad7de-a371-4e97-844c-21709bddfc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01ad7de-a371-4e97-844c-21709bddfc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68bc68ce-8ca5-49d0-bd95-fbaa84884b2b', 'volume_name': 'volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b', 'volume_size': 2, 'snapshot_id': 'b18da723-4706-48f8-974d-6dec627373a5'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d297f92-2f80-454c-888b-dd3628e93b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d297f92-2f80-454c-888b-dd3628e93b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106ea8c6-f5e9-4712-aa57-b4f0c591725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Volume 68bc68ce-8ca5-49d0-bd95-fbaa84884b2b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b', 'volume_size': 2, 'snapshot_id': 'b18da723-4706-48f8-974d-6dec627373a5'} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:33 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" returned: 0 in 0.711s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.329s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-b18da723-4706-48f8-974d-6dec627373a5-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" by "_create_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1e279f-08e8-4f3b-9642-21ff2b43a689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21', 'volume_size': 2}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acaf7c0-0a75-4213-9f4f-fed9a081c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-b18da723-4706-48f8-974d-6dec627373a5-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Creating volume 68bc68ce-8ca5-49d0-bd95-fbaa84884b2b from snapshot b18da723-4706-48f8-974d-6dec627373a5 {{(pid=86664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Flow 'volume_create_manager' (12eb6c19-c6cf-4aa3-8dc8-74243a514620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48dc5fe5-dd4b-4238-b624-e5b03bbc88ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Volume volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 (21a7c8a4-8b8f-48e7-a717-bc5e91923b21): created successfully Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acaf7c0-0a75-4213-9f4f-fed9a081c404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Flow 'volume_create_manager' (cdfeaee4-459e-4f9d-87e3-aed18518fc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" acquired by "_copy_volume_from_snapshot" :: waited 0.071s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] snapshot: b18da723-4706-48f8-974d-6dec627373a5, volume: 68bc68ce-8ca5-49d0-bd95-fbaa84884b2b, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48dc5fe5-dd4b-4238-b624-e5b03bbc88ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1876026934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ea75ac-351e-4bc4-96f8-a740d72b9089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a5ef5f635a4f1d856e5cd559f45b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:33Z,use_quota=True,user_id='d36cbf8e015240b38ccfc8a265b81cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a9fc57-1a92-4d34-9922-76f1a385c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a9fc57-1a92-4d34-9922-76f1a385c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944f570c-b0c3-469d-b459-f982378f6913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944f570c-b0c3-469d-b459-f982378f6913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ea75ac-351e-4bc4-96f8-a740d72b9089', 'volume_name': 'volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f66a64b-0721-4df0-96e9-3e756e309a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f66a64b-0721-4df0-96e9-3e756e309a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0782ad64-8781-48d0-9966-05fe261dc612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Volume b4ea75ac-351e-4bc4-96f8-a740d72b9089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089', 'volume_size': 1} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-73524004-0bae-46ca-8258-c80dddce05fb tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Created volume successfully. Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7693423d-4348-4d3b-b6f6-262fccc23635]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:33 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 Jul 05 18:31:33 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:34 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5" returned: 0 in 0.824s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:31:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:31:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:31:34 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a2c385-d5cb-497b-af64-bd0fd3c0934d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:34 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 Jul 05 18:31:34 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:35 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" returned: 0 in 0.827s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:35 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:31:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:35 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b Jul 05 18:31:35 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:40 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" returned: 0 in 4.746s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:40 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3401745e-17bb-41d1-8a8a-efc5f1d28def]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:40 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 Jul 05 18:31:40 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:41 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" returned: 0 in 1.062s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:31:41 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Converted 1024.00 MB image at 215.72 MB/s Jul 05 18:31:41 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b is being set with open permissions: ugo+rw Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:41 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b Jul 05 18:31:41 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:41 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" returned: 0 in 0.683s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" released by "_copy_volume_from_snapshot" :: held 8.294s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-b18da723-4706-48f8-974d-6dec627373a5-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" released by "_create_volume_from_snapshot" :: held 8.382s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.424s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.255s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1876026934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ea75ac-351e-4bc4-96f8-a740d72b9089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a5ef5f635a4f1d856e5cd559f45b6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:33Z,use_quota=True,user_id='d36cbf8e015240b38ccfc8a265b81cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Creating volume b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:41 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:41 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 1073741824 Jul 05 18:31:41 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106ea8c6-f5e9-4712-aa57-b4f0c591725a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b', 'volume_size': 2, 'snapshot_id': 'b18da723-4706-48f8-974d-6dec627373a5'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb3abb4-5013-429c-b607-c0db33eceaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:41 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Volume volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b (68bc68ce-8ca5-49d0-bd95-fbaa84884b2b): created successfully Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb3abb4-5013-429c-b607-c0db33eceaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (23b461b5-cf88-47b5-a9a5-be4f5ca106ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0a4e6ea7-8700-479d-9875-b5e89462a801 tempest-VolumesSnapshotTestJSON-1886162574 None] Created volume successfully. Jul 05 18:31:42 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 1073741824" returned: 0 in 0.935s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:42 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 Jul 05 18:31:42 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:42 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[440b49bc-84e8-41de-956e-c99b8d95c987]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:43 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b Jul 05 18:31:43 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:43 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089" returned: 0 in 0.735s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.864s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Creating offline snapshot 5f4105e7-1f2c-49ab-8c7d-2023c458ca78 of volume 21a7c8a4-8b8f-48e7-a717-bc5e91923b21 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0782ad64-8781-48d0-9966-05fe261dc612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826e70f6-5f54-4230-a5e0-e1a967e26f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7489f70e-fb1c-464f-9068-a1b50491ea8d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:43 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Volume volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 (b4ea75ac-351e-4bc4-96f8-a740d72b9089): created successfully Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826e70f6-5f54-4230-a5e0-e1a967e26f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Flow 'volume_create_manager' (12eb6c19-c6cf-4aa3-8dc8-74243a514620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:43 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8cc3b259-e908-4959-9c24-083af64cf22f tempest-VolumesSnapshotListTestJSON-1089717927 None] Created volume successfully. Jul 05 18:31:43 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 Jul 05 18:31:43 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:43 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" returned: 0 in 0.884s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:43 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b Jul 05 18:31:43 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:44 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" returned: 0 in 0.698s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b" released by "delete_volume" :: held 1.642s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:44 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" returned: 0 in 0.924s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 2G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:44 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 2G Jul 05 18:31:44 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Created reservations ['4cb98d39-1abc-4c7d-aee8-ae53e0d02371', '3194a8a6-0188-4ece-92b0-eb05c6d8e245', '020a44f4-41f7-4145-98e2-721d0e8721a5', 'ad656b8f-6bb0-458d-9ddc-737b3146ad22'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:44 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:44 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-b18da723-4706-48f8-974d-6dec627373a5-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-b18da723-4706-48f8-974d-6dec627373a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-b18da723-4706-48f8-974d-6dec627373a5" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-b18da723-4706-48f8-974d-6dec627373a5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Deleting offline snapshot b18da723-4706-48f8-974d-6dec627373a5 of volume 06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] snapshot_file for this snap is: volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[04090146-411d-4a7b-ae99-51435f62dd1a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:45 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 Jul 05 18:31:45 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:45 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.791s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Deleted volume successfully. Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a83e6402-008f-4f35-a3dc-725eb6cff798 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-68bc68ce-8ca5-49d0-bd95-fbaa84884b2b-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:45 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 2G" returned: 0 in 1.050s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:45 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 Jul 05 18:31:45 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:46 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5" returned: 0 in 0.986s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:31:46 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[35180909-0d60-4f17-b706-ad72d7cea473]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:46 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 Jul 05 18:31:46 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:46 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78" returned: 0 in 0.835s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:46 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 is being set with open permissions: ugo+rw Jul 05 18:31:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:46 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 Jul 05 18:31:46 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:47 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" returned: 0 in 0.876s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:47 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 Jul 05 18:31:47 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:47 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78" returned: 0 in 0.754s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:47 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.info Jul 05 18:31:47 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:47 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.info" returned: 0 in 0.706s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:47 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.info is being set with open permissions: ugo+rw Jul 05 18:31:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:48 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.info Jul 05 18:31:48 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:48 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5" returned: 0 in 0.876s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:48 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5 Jul 05 18:31:48 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:48 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.info" returned: 0 in 0.743s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:48 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.123s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.919s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9.b18da723-4706-48f8-974d-6dec627373a5" returned: 0 in 0.718s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Creating offline snapshot 2f9d70a8-eaac-49c8-bb0d-5baf2916216b of volume b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b839750-66cb-4266-b6e6-832b7f7355e7]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b2b2fcf1-20be-4c97-aac5-0b4b64249e9d tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Create snapshot completed successfully Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-b18da723-4706-48f8-974d-6dec627373a5" released by "_delete_snapshot" :: held 3.613s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" released by "delete_snapshot" :: held 3.647s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:48 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Created reservations ['a7bad5bd-fe6f-4887-82a7-4ca28f189c4d', '47caf9dc-36ae-4216-980b-22622bfe1644', 'a6f84dda-6bb7-481e-8117-18907e29d68f', '5be7dbd2-c1cb-42cd-92e5-4e88bc785c82'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:48 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 Jul 05 18:31:48 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:49 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Delete snapshot completed successfully. Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5dd2a734-6b39-484d-8d5f-4e456aef7484 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-b18da723-4706-48f8-974d-6dec627373a5-delete_snapshot" released by "delete_snapshot" :: held 3.840s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-06bd76e2-7bff-4da3-ab72-0b293ad51fc9-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-06bd76e2-7bff-4da3-ab72-0b293ad51fc9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" acquired by "delete_volume" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5117dd41-4e00-4667-915d-f2024b194614]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Acquiring lock "cinder-5f4105e7-1f2c-49ab-8c7d-2023c458ca78-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:49 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089" returned: 0 in 0.936s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-5f4105e7-1f2c-49ab-8c7d-2023c458ca78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Acquiring lock "cinder-quobyte-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:49 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b 1G Jul 05 18:31:49 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-quobyte-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Acquiring lock "cinder-quobyte-5f4105e7-1f2c-49ab-8c7d-2023c458ca78" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-quobyte-5f4105e7-1f2c-49ab-8c7d-2023c458ca78" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Deleting offline snapshot 5f4105e7-1f2c-49ab-8c7d-2023c458ca78 of volume 21a7c8a4-8b8f-48e7-a717-bc5e91923b21 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] snapshot_file for this snap is: volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:31:49 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 Jul 05 18:31:49 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd97cc2-85ee-458d-91ef-15785df51c9d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:49 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 Jul 05 18:31:49 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:50 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" returned: 0 in 0.917s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:50 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9 Jul 05 18:31:50 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:50 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b 1G" returned: 0 in 0.930s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:50 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b Jul 05 18:31:50 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:50 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78" returned: 0 in 1.002s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:50 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:31:50 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beb836b-bb89-418d-be95-51f25510326f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:51 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 Jul 05 18:31:51 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:51 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" returned: 0 in 0.781s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-06bd76e2-7bff-4da3-ab72-0b293ad51fc9" released by "delete_volume" :: held 1.785s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Created reservations ['8b730642-8e8e-49c3-8dcd-5eb6e254d152', '41568a03-9212-4f40-b5f8-36c33637dfae', 'a12451d4-d49f-4ab1-935e-16135eb14cf8', '1bfcc304-2e49-492c-ba58-b1a7ad2b281c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:51 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b" returned: 0 in 0.933s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:51 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b is being set with open permissions: ugo+rw Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:51 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:51 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:51 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b Jul 05 18:31:51 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:51 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" returned: 0 in 0.919s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:51 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 Jul 05 18:31:51 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (70a74706-2348-409f-beb6-77cd07cfd915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14333cbc-1555-4f28-a34d-00d49ee52e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14333cbc-1555-4f28-a34d-00d49ee52e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1050614112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c41813-ebf1-496b-ad6b-a7c4cb430088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bc075a603345419b5f32d50c6da096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:52Z,use_quota=True,user_id='b346f876d9e34b4e8583de5a8defbd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aad06e7-721e-4620-8ff3-600662da6946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aad06e7-721e-4620-8ff3-600662da6946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d261734-2c28-4daf-8c20-7a46ec1b72ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d261734-2c28-4daf-8c20-7a46ec1b72ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c41813-ebf1-496b-ad6b-a7c4cb430088', 'volume_name': 'volume-90c41813-ebf1-496b-ad6b-a7c4cb430088', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047d66c9-82f3-4ea2-ae05-b4a151c13b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047d66c9-82f3-4ea2-ae05-b4a151c13b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f09a9e-f85a-4e5c-8c9e-1983d346f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:52 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Volume 90c41813-ebf1-496b-ad6b-a7c4cb430088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c41813-ebf1-496b-ad6b-a7c4cb430088', 'volume_size': 1} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:52 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b" returned: 0 in 0.920s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:52 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.987s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:52 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Deleted volume successfully. Jul 05 18:31:52 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.info Jul 05 18:31:52 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c837360-a46e-4f46-9a58-9dba6eca5972 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-06bd76e2-7bff-4da3-ab72-0b293ad51fc9-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:52 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78" returned: 0 in 0.984s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:52 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78 Jul 05 18:31:52 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:53 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.info" returned: 0 in 0.798s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:53 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.info is being set with open permissions: ugo+rw Jul 05 18:31:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:53 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.info Jul 05 18:31:53 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:53 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21.5f4105e7-1f2c-49ab-8c7d-2023c458ca78" returned: 0 in 0.769s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-quobyte-5f4105e7-1f2c-49ab-8c7d-2023c458ca78" released by "_delete_snapshot" :: held 3.810s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-quobyte-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" released by "delete_snapshot" :: held 3.837s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:53 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Created reservations ['a475eafb-c200-405c-82e6-262eb9ea7e7d', 'e29cbeaf-689a-458b-bd9d-dcb36d75bf0f', 'fbdf89ab-06d6-4fee-a170-c46107420256', '7c90b6dc-18a2-4742-a66f-f91e0844481d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:53 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Delete snapshot completed successfully. Jul 05 18:31:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bc2caa1c-4a83-4fed-918a-954287a07d8e tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-5f4105e7-1f2c-49ab-8c7d-2023c458ca78-delete_snapshot" released by "delete_snapshot" :: held 4.014s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Acquiring lock "cinder-21a7c8a4-8b8f-48e7-a717-bc5e91923b21-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-21a7c8a4-8b8f-48e7-a717-bc5e91923b21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:54 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.info" returned: 0 in 0.696s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.347s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1050614112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c41813-ebf1-496b-ad6b-a7c4cb430088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bc075a603345419b5f32d50c6da096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:31:52Z,use_quota=True,user_id='b346f876d9e34b4e8583de5a8defbd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Creating volume 90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:31:54 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Acquiring lock "cinder-quobyte-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:31:54 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 1073741824 Jul 05 18:31:54 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4bc38ef9-c2cb-4228-8f4d-453089195a95 tempest-VolumesSnapshotListTestJSON-1089717927 None] Create snapshot completed successfully Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-quobyte-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[65481b6a-18c7-4861-8871-9d50f1d627c3]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:54 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 Jul 05 18:31:54 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:55 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 1073741824" returned: 0 in 0.990s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:55 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" returned: 0 in 0.876s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:55 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21 Jul 05 18:31:55 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:55 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 Jul 05 18:31:55 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:55 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" returned: 0 in 0.765s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-quobyte-21a7c8a4-8b8f-48e7-a717-bc5e91923b21" released by "delete_volume" :: held 1.738s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Created reservations ['350ab028-8293-4eaf-bc4a-8e8927572355', '9922207e-9057-4742-883c-ea3fdff9c6e9', '240524f3-597b-4be9-bb7e-2a5d584b7636', '5f18a863-07b7-4c3c-bc15-bfea006b05f3'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:31:55 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088" returned: 0 in 0.811s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.429s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f09a9e-f85a-4e5c-8c9e-1983d346f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c41813-ebf1-496b-ad6b-a7c4cb430088', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f64309-1eb1-4ad6-ac90-ced512753d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Creating offline snapshot c0c40413-071d-4bb1-b0b9-39d704990f51 of volume b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:31:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Volume volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 (90c41813-ebf1-496b-ad6b-a7c4cb430088): created successfully Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f64309-1eb1-4ad6-ac90-ced512753d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (70a74706-2348-409f-beb6-77cd07cfd915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af7be3a-b05f-4e72-8875-9a4e6cda648f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ccb35792-62a5-4462-b46e-0c16d7aec828 tempest-VolumesSnapshotTestJSON-1886162574 None] Created volume successfully. Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:56 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:31:56 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:56 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b Jul 05 18:31:56 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:56 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.742s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:31:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Deleted volume successfully. Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-55c5982f-717b-4539-817c-fa22c25ffbd1 tempest-VolumesSnapshotNegativeTestJSON-1233509115 None] Lock "cinder-21a7c8a4-8b8f-48e7-a717-bc5e91923b21-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:31:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:31:57 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b" returned: 0 in 0.996s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:31:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:57 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 1G Jul 05 18:31:57 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:58 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 1G" returned: 0 in 0.906s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:58 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 Jul 05 18:31:58 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:58 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51" returned: 0 in 0.776s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:58 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 is being set with open permissions: ugo+rw Jul 05 18:31:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:58 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 Jul 05 18:31:58 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:59 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51" returned: 0 in 0.704s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.550s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.566s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Creating offline snapshot ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 of volume 90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:31:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c620decb-64b6-4caa-9783-6e9d8c4c9ed5 tempest-VolumesSnapshotListTestJSON-1089717927 None] Create snapshot completed successfully Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7b39cc-8213-48b4-9309-518fa657ce24]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (63cbae18-c86f-439f-b168-55d8ed7f5f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17de3421-fe41-4e44-af68-906f6030bbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:59 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 Jul 05 18:31:59 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17de3421-fe41-4e44-af68-906f6030bbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148818879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba3f847-11cb-4871-b2d7-2318f90389fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:00Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc229e3-4812-4530-9042-58782a2eac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc229e3-4812-4530-9042-58782a2eac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d229afa-9599-4287-9b62-388c477dbcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d229afa-9599-4287-9b62-388c477dbcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba3f847-11cb-4871-b2d7-2318f90389fd', 'volume_name': 'volume-8ba3f847-11cb-4871-b2d7-2318f90389fd', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ee70f4-afd0-49d9-b713-906936fa709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ee70f4-afd0-49d9-b713-906936fa709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2fbc78-59eb-460a-bf31-7f753a26efc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:31:59 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume 8ba3f847-11cb-4871-b2d7-2318f90389fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba3f847-11cb-4871-b2d7-2318f90389fd', 'volume_size': 1} Jul 05 18:31:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:00 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088" returned: 0 in 0.843s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:00 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 1G Jul 05 18:32:00 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:01 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 1G" returned: 0 in 0.918s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:01 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 Jul 05 18:32:01 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:02 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7" returned: 0 in 0.779s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:02 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 is being set with open permissions: ugo+rw Jul 05 18:32:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:02 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 Jul 05 18:32:02 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:02 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7" returned: 0 in 0.714s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:02 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.info Jul 05 18:32:02 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:03 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.info" returned: 0 in 0.700s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:03 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.info is being set with open permissions: ugo+rw Jul 05 18:32:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:03 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.info Jul 05 18:32:03 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:04 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.info" returned: 0 in 0.649s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.718s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.460s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-148818879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba3f847-11cb-4871-b2d7-2318f90389fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:00Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Creating volume 8ba3f847-11cb-4871-b2d7-2318f90389fd {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:32:04 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:32:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:04 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd 1073741824 Jul 05 18:32:04 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1fcf4a4d-7a89-4914-a677-3d17fd4810b9 tempest-VolumesSnapshotTestJSON-1886162574 None] Create snapshot completed successfully Jul 05 18:32:05 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd 1073741824" returned: 0 in 0.866s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:05 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd Jul 05 18:32:05 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:05 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd" returned: 0 in 0.648s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.841s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Creating offline snapshot 60064326-4c1a-4eb3-8430-0e1f92a367ab of volume b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2fbc78-59eb-460a-bf31-7f753a26efc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba3f847-11cb-4871-b2d7-2318f90389fd', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c8504a-ca6b-4915-b42a-ac4925338932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5337a5d5-45c3-41f9-9a87-b837e27fba6d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:05 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume volume-8ba3f847-11cb-4871-b2d7-2318f90389fd (8ba3f847-11cb-4871-b2d7-2318f90389fd): created successfully Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c8504a-ca6b-4915-b42a-ac4925338932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (63cbae18-c86f-439f-b168-55d8ed7f5f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:32:06 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-03266f43-f401-431d-8316-6aa39a747d8c tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created volume successfully. Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (55cbb055-7a01-4702-8f0b-dcbff2e5896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:06 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 Jul 05 18:32:06 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e6d9f3-6f29-4d5a-adf5-802fa306ea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e6d9f3-6f29-4d5a-adf5-802fa306ea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1442633655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b306dcf-e421-4f3c-9db2-ee7413069e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bc075a603345419b5f32d50c6da096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea19c76f-3ce0-41a9-bcf1-479099a9c9b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:06Z,use_quota=True,user_id='b346f876d9e34b4e8583de5a8defbd96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa792b7c-8f57-4b54-a038-87bee87f630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa792b7c-8f57-4b54-a038-87bee87f630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeb2fab-71ab-4107-8829-a0bfc4db95e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeb2fab-71ab-4107-8829-a0bfc4db95e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b306dcf-e421-4f3c-9db2-ee7413069e86', 'volume_name': 'volume-0b306dcf-e421-4f3c-9db2-ee7413069e86', 'volume_size': 1, 'snapshot_id': 'ea19c76f-3ce0-41a9-bcf1-479099a9c9b7'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d960e710-0330-4812-a68c-b63b00f8aa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d960e710-0330-4812-a68c-b63b00f8aa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b5a402-a514-4a25-99fa-d9756419a557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:06 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Volume 0b306dcf-e421-4f3c-9db2-ee7413069e86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b306dcf-e421-4f3c-9db2-ee7413069e86', 'volume_size': 1, 'snapshot_id': 'ea19c76f-3ce0-41a9-bcf1-479099a9c9b7'} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:06 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51" returned: 0 in 0.777s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:32:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:06 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab 1G Jul 05 18:32:06 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:07 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab 1G" returned: 0 in 0.977s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:07 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab Jul 05 18:32:07 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:08 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab" returned: 0 in 0.714s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:08 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab is being set with open permissions: ugo+rw Jul 05 18:32:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:08 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab Jul 05 18:32:08 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:09 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab" returned: 0 in 0.685s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.296s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.998s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-ea19c76f-3ce0-41a9-bcf1-479099a9c9b7-0b306dcf-e421-4f3c-9db2-ee7413069e86" by "_create_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-ea19c76f-3ce0-41a9-bcf1-479099a9c9b7-0b306dcf-e421-4f3c-9db2-ee7413069e86" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Creating volume 0b306dcf-e421-4f3c-9db2-ee7413069e86 from snapshot ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 {{(pid=86664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-0b306dcf-e421-4f3c-9db2-ee7413069e86" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-0b306dcf-e421-4f3c-9db2-ee7413069e86" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] snapshot: ea19c76f-3ce0-41a9-bcf1-479099a9c9b7, volume: 0b306dcf-e421-4f3c-9db2-ee7413069e86, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:32:09 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ddd5e209-c7a9-4bfe-9031-ad5794c13559 tempest-VolumesSnapshotListTestJSON-1089717927 None] Create snapshot completed successfully Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f2f07f-4b76-4d03-88ad-d42cff0aecba]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:09 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 Jul 05 18:32:09 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:10 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7" returned: 0 in 0.914s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c41813-ebf1-496b-ad6b-a7c4cb430088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad47164-57a4-4bc1-8014-dfa4b0a86be8]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-60064326-4c1a-4eb3-8430-0e1f92a367ab-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-60064326-4c1a-4eb3-8430-0e1f92a367ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:10 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 Jul 05 18:32:10 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-quobyte-60064326-4c1a-4eb3-8430-0e1f92a367ab" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-60064326-4c1a-4eb3-8430-0e1f92a367ab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Deleting offline snapshot 60064326-4c1a-4eb3-8430-0e1f92a367ab of volume b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] snapshot_file for this snap is: volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6054bf94-1478-4f60-a690-3a335f4f7a93]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:10 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab Jul 05 18:32:10 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:11 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088" returned: 0 in 0.871s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:11 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:32:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:11 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 Jul 05 18:32:11 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:11 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab" returned: 0 in 0.946s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:32:11 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0919653-07f3-4637-8ab2-c97f53094041]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:11 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 Jul 05 18:32:11 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:12 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:12 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:12 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51" returned: 0 in 1.507s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:32:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:12 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab Jul 05 18:32:12 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:14 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 2.174s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:14 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:14 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:32:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:32:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:32:15 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab" returned: 0 in 2.166s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:15 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab Jul 05 18:32:15 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:16 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.60064326-4c1a-4eb3-8430-0e1f92a367ab" returned: 0 in 1.197s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-60064326-4c1a-4eb3-8430-0e1f92a367ab" released by "_delete_snapshot" :: held 5.967s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" released by "delete_snapshot" :: held 6.001s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=121,cinder:INSERT=42,cinder:SELECT=105,cinder:DELETE=11 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=113,cinder:INSERT=28,cinder:DELETE=13,cinder:UPDATE=119 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Created reservations ['8fe9b785-3cae-4689-a304-c4733e0adee2', '7913bdf6-efa8-4bbc-86db-559f52ba09a9', '816a1a10-9b48-4ca2-a32b-7ae0b7c80f85', '7f801aef-2c47-40f4-9bff-1df880984b27'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Delete snapshot completed successfully. Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e71a1b0c-1f39-4aca-ad64-9e2c1a15e5c8 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-60064326-4c1a-4eb3-8430-0e1f92a367ab-delete_snapshot" released by "delete_snapshot" :: held 6.324s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:16 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86" returned: 0 in 5.660s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6015e7-2507-462d-94af-ffab9ba5b759]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:16 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 Jul 05 18:32:16 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-c0c40413-071d-4bb1-b0b9-39d704990f51-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-c0c40413-071d-4bb1-b0b9-39d704990f51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-quobyte-c0c40413-071d-4bb1-b0b9-39d704990f51" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-c0c40413-071d-4bb1-b0b9-39d704990f51" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Deleting offline snapshot c0c40413-071d-4bb1-b0b9-39d704990f51 of volume b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] snapshot_file for this snap is: volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5059b0a7-2eca-4345-a9d9-e3448b59ea16]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:17 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 Jul 05 18:32:17 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:17 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088" returned: 0 in 1.021s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:32:17 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Converted 1024.00 MB image at 180.89 MB/s Jul 05 18:32:17 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 is being set with open permissions: ugo+rw Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:17 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 Jul 05 18:32:17 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:17 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51" returned: 0 in 0.775s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[db051e63-c9f1-4f53-b944-eb59017b97a2]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:17 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b Jul 05 18:32:17 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:18 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86" returned: 0 in 0.731s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-0b306dcf-e421-4f3c-9db2-ee7413069e86" released by "_copy_volume_from_snapshot" :: held 9.306s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-ea19c76f-3ce0-41a9-bcf1-479099a9c9b7-0b306dcf-e421-4f3c-9db2-ee7413069e86" released by "_create_volume_from_snapshot" :: held 9.338s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.361s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.111s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Creating offline snapshot f4ee3c40-4d29-4d73-b071-b4e240b40ead of volume 8ba3f847-11cb-4871-b2d7-2318f90389fd {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b5a402-a514-4a25-99fa-d9756419a557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b306dcf-e421-4f3c-9db2-ee7413069e86', 'volume_size': 1, 'snapshot_id': 'ea19c76f-3ce0-41a9-bcf1-479099a9c9b7'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c5035b-d5f0-4771-ac1d-4c8de6577474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6039822-9e02-4143-8499-ce300847dc29]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:18 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Volume volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 (0b306dcf-e421-4f3c-9db2-ee7413069e86): created successfully Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c5035b-d5f0-4771-ac1d-4c8de6577474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Flow 'volume_create_manager' (55cbb055-7a01-4702-8f0b-dcbff2e5896b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:18 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b" returned: 0 in 0.780s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:32:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:18 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-cef94fd5-5c4b-4f40-8d87-e4f48b181150 tempest-VolumesSnapshotTestJSON-1886162574 None] Created volume successfully. Jul 05 18:32:18 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 Jul 05 18:32:18 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:18 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd Jul 05 18:32:18 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-0b306dcf-e421-4f3c-9db2-ee7413069e86-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:19 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd" returned: 0 in 0.808s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-0b306dcf-e421-4f3c-9db2-ee7413069e86-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:19 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead 1G Jul 05 18:32:19 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-0b306dcf-e421-4f3c-9db2-ee7413069e86" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-0b306dcf-e421-4f3c-9db2-ee7413069e86" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[57634b14-8a8e-4b0d-9674-003d87892ad0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:19 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51" returned: 0 in 0.887s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:19 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51 Jul 05 18:32:19 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:19 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 Jul 05 18:32:19 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:20 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.c0c40413-071d-4bb1-b0b9-39d704990f51" returned: 0 in 0.741s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-c0c40413-071d-4bb1-b0b9-39d704990f51" released by "_delete_snapshot" :: held 3.313s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" released by "delete_snapshot" :: held 3.347s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:20 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Created reservations ['2b354bc0-5423-4950-9472-f5bfb59562c2', '51662070-f027-40f8-976a-65cac2adc31b', '6f405742-340c-4b97-924e-296f13095d4a', 'f67bb544-fc5a-473f-a826-3557d366f025'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:20 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead 1G" returned: 0 in 1.011s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ba3f847-11cb-4871-b2d7-2318f90389fd -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:20 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:20 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ba3f847-11cb-4871-b2d7-2318f90389fd -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead Jul 05 18:32:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86" returned: 0 in 0.918s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:20 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:20 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86 Jul 05 18:32:20 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Delete snapshot completed successfully. Jul 05 18:32:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9c0fd426-5efc-44f7-8496-88bbcfeb4ec9 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-c0c40413-071d-4bb1-b0b9-39d704990f51-delete_snapshot" released by "delete_snapshot" :: held 3.578s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:21 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ba3f847-11cb-4871-b2d7-2318f90389fd -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead" returned: 0 in 0.751s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:21 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead is being set with open permissions: ugo+rw Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:21 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead Jul 05 18:32:21 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-2f9d70a8-eaac-49c8-bb0d-5baf2916216b-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:21 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b306dcf-e421-4f3c-9db2-ee7413069e86" returned: 0 in 0.789s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-2f9d70a8-eaac-49c8-bb0d-5baf2916216b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-0b306dcf-e421-4f3c-9db2-ee7413069e86" released by "delete_volume" :: held 1.775s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-quobyte-2f9d70a8-eaac-49c8-bb0d-5baf2916216b" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-2f9d70a8-eaac-49c8-bb0d-5baf2916216b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Deleting offline snapshot 2f9d70a8-eaac-49c8-bb0d-5baf2916216b of volume b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] snapshot_file for this snap is: volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8006d32a-87da-4808-8c56-115be5faf0c0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Created reservations ['687fb098-1484-46ca-98e5-0cda76bc5392', '396111bf-c210-49a4-8adf-57de79474a27', 'd3eb77fb-b0fc-42ad-8e59-8da8e97aa381', 'cde11345-c427-4f8c-b551-b37d36209fa5'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:21 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b Jul 05 18:32:21 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:21 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:21 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-ea19c76f-3ce0-41a9-bcf1-479099a9c9b7-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-ea19c76f-3ce0-41a9-bcf1-479099a9c9b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-90c41813-ebf1-496b-ad6b-a7c4cb430088" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-90c41813-ebf1-496b-ad6b-a7c4cb430088" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-ea19c76f-3ce0-41a9-bcf1-479099a9c9b7" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-ea19c76f-3ce0-41a9-bcf1-479099a9c9b7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Deleting offline snapshot ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 of volume 90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] snapshot_file for this snap is: volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c791e3fa-dcd4-48f5-b007-2da46e794212]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:21 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead" returned: 0 in 0.780s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:21 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 Jul 05 18:32:21 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:21 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.info Jul 05 18:32:22 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:22 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.753s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Deleted volume successfully. Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abacaa83-2439-430a-bc97-8ab747c65a24 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-0b306dcf-e421-4f3c-9db2-ee7413069e86-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:22 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b" returned: 0 in 0.994s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bc3a6a-c155-4a53-aa63-754909d75d9e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:22 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 Jul 05 18:32:22 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:22 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.info" returned: 0 in 0.737s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:22 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.info is being set with open permissions: ugo+rw Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:22 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.info Jul 05 18:32:22 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:22 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7" returned: 0 in 0.942s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90c41813-ebf1-496b-ad6b-a7c4cb430088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0b2726-a918-4d39-bd36-4ef602e68ba7]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:22 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 Jul 05 18:32:22 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:23 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089" returned: 0 in 0.851s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:23 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b Jul 05 18:32:23 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:23 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.info" returned: 0 in 0.678s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.884s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:23 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5b32f851-1498-4d71-b2d8-a1f68fe68190 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Create snapshot completed successfully Jul 05 18:32:23 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088" returned: 0 in 0.854s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:23 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 Jul 05 18:32:23 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:24 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b" returned: 0 in 0.835s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:24 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b Jul 05 18:32:24 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:24 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7" returned: 0 in 0.909s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:24 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7 Jul 05 18:32:24 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:24 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089.2f9d70a8-eaac-49c8-bb0d-5baf2916216b" returned: 0 in 0.790s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-2f9d70a8-eaac-49c8-bb0d-5baf2916216b" released by "_delete_snapshot" :: held 3.629s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" released by "delete_snapshot" :: held 3.669s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (f9ea8220-3bcb-42a3-89bd-3d3e462717e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:24 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7839411c-7897-48a3-8d02-db1c0ee67fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7839411c-7897-48a3-8d02-db1c0ee67fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549351563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd436be-1eee-4127-919c-fdd81f9f6155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:25Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748ff309-b5ce-436c-8e09-94134c989d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748ff309-b5ce-436c-8e09-94134c989d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a04105-3b4b-48b5-a1c7-192742ce2167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a04105-3b4b-48b5-a1c7-192742ce2167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd436be-1eee-4127-919c-fdd81f9f6155', 'volume_name': 'volume-1fd436be-1eee-4127-919c-fdd81f9f6155', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057f196e-b254-4fca-aa28-010ebcbf7bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057f196e-b254-4fca-aa28-010ebcbf7bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bebea31-3d66-4792-b5fc-967c3f78bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume 1fd436be-1eee-4127-919c-fdd81f9f6155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd436be-1eee-4127-919c-fdd81f9f6155', 'volume_size': 1} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1549351563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd436be-1eee-4127-919c-fdd81f9f6155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:25Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Creating volume 1fd436be-1eee-4127-919c-fdd81f9f6155 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:32:25 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:25 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155 1073741824 Jul 05 18:32:25 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Created reservations ['ca4ea222-1f75-415a-81df-d15213a8d885', 'b992863b-9b7d-4988-96d2-8a2d18b89e9d', '5aaa1cd0-572f-4ce5-a026-eb0ce88f18e2', 'b07c6bb1-d904-4b4c-b6cf-af68d983ff7a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Delete snapshot completed successfully. Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5014284f-d718-40c3-b1eb-d5988f3ede0c tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-2f9d70a8-eaac-49c8-bb0d-5baf2916216b-delete_snapshot" released by "delete_snapshot" :: held 4.104s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:25 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088.ea19c76f-3ce0-41a9-bcf1-479099a9c9b7" returned: 0 in 0.891s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (3e7ac8bd-2698-4838-a16a-72e8593666ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f335a0bd-28f4-49f5-b058-2c12a7afd801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-ea19c76f-3ce0-41a9-bcf1-479099a9c9b7" released by "_delete_snapshot" :: held 3.762s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-90c41813-ebf1-496b-ad6b-a7c4cb430088" released by "delete_snapshot" :: held 3.800s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f335a0bd-28f4-49f5-b058-2c12a7afd801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1970597464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2717b2f-5a60-4eea-a0dd-ae5053141203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:25Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a99c2b-ec1c-4110-8687-de65bef90c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a99c2b-ec1c-4110-8687-de65bef90c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b297ef4-4a31-4175-9e16-7f62a02f71c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b297ef4-4a31-4175-9e16-7f62a02f71c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2717b2f-5a60-4eea-a0dd-ae5053141203', 'volume_name': 'volume-c2717b2f-5a60-4eea-a0dd-ae5053141203', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfccffc-0e04-4cba-8bf2-0cf5623aa89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfccffc-0e04-4cba-8bf2-0cf5623aa89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552f0be7-c147-4928-8e0e-dc82bf04ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:25 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume c2717b2f-5a60-4eea-a0dd-ae5053141203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2717b2f-5a60-4eea-a0dd-ae5053141203', 'volume_size': 1} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-b4ea75ac-351e-4bc4-96f8-a740d72b9089-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-b4ea75ac-351e-4bc4-96f8-a740d72b9089-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7716e08e-a736-4471-9ce9-8de287254df6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:25 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Created reservations ['4aec5556-6d73-493b-b844-2d19b3868d2f', 'c9359b0f-0b8f-4425-9543-7395c5caab81', 'd15f736d-5117-4d94-ae12-8a973ec1d80d', 'f6311468-07d9-4886-a8f3-a14ec48a9b3a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:25 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 Jul 05 18:32:25 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:26 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Delete snapshot completed successfully. Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-30e37aba-edac-4f2f-8154-79e91af4f2d6 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-ea19c76f-3ce0-41a9-bcf1-479099a9c9b7-delete_snapshot" released by "delete_snapshot" :: held 4.302s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (ff713009-3fb3-44c5-9f99-43ca4d422295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae8fe2d-9949-4d02-9c58-2c0ec6f00ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae8fe2d-9949-4d02-9c58-2c0ec6f00ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-265195308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a996115-775f-4703-9238-99ade969e4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:26Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998f78fe-033e-4751-b2c1-5348404c2f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998f78fe-033e-4751-b2c1-5348404c2f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfde09fe-4531-4e96-9641-74c91eebcf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfde09fe-4531-4e96-9641-74c91eebcf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a996115-775f-4703-9238-99ade969e4ce', 'volume_name': 'volume-0a996115-775f-4703-9238-99ade969e4ce', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c8c280-0179-4326-be46-a2730ec255d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c8c280-0179-4326-be46-a2730ec255d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b8e991-1912-4579-9d52-44136dd1eabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume 0a996115-775f-4703-9238-99ade969e4ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a996115-775f-4703-9238-99ade969e4ce', 'volume_size': 1} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (008702e7-87b7-4b9f-a59a-df2bb683c629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ce724d-71f6-4a53-9411-172ba83fc655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ce724d-71f6-4a53-9411-172ba83fc655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-500652481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501ec7f2-431c-487a-a76c-07195dbcc054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:26Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b43bad-b1e2-4bd0-9dab-44b4ef1eb8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b43bad-b1e2-4bd0-9dab-44b4ef1eb8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5ecb44-31f9-41fb-b277-b6f3f30c9820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5ecb44-31f9-41fb-b277-b6f3f30c9820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501ec7f2-431c-487a-a76c-07195dbcc054', 'volume_name': 'volume-501ec7f2-431c-487a-a76c-07195dbcc054', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb34e03c-2c15-4e89-be37-184a6c368661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb34e03c-2c15-4e89-be37-184a6c368661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:26 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e6eec7-9f76-4693-a5dd-2f1fdd696316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:26 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume 501ec7f2-431c-487a-a76c-07195dbcc054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501ec7f2-431c-487a-a76c-07195dbcc054', 'volume_size': 1} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155 1073741824" returned: 0 in 1.576s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:26 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155 Jul 05 18:32:26 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:32:27 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (ba91ad65-525d-4b8e-a757-b079a4db10b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f466a2ee-8b00-4da8-9b62-b8a006c174f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089" returned: 0 in 1.276s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f466a2ee-8b00-4da8-9b62-b8a006c174f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1808933074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:27Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6a580f-6414-402d-91d5-ff8ebdb16180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:27 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089 Jul 05 18:32:27 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6a580f-6414-402d-91d5-ff8ebdb16180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b739fc6c-8d72-418a-a9f0-2808c6de22e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b739fc6c-8d72-418a-a9f0-2808c6de22e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6', 'volume_name': 'volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9c4f77-83dd-46fe-b11b-bf2a71a05069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9c4f77-83dd-46fe-b11b-bf2a71a05069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7473476-7bf3-4dd3-9f01-9898f179ad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:27 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume 7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6', 'volume_size': 1} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-90c41813-ebf1-496b-ad6b-a7c4cb430088-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-90c41813-ebf1-496b-ad6b-a7c4cb430088-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-90c41813-ebf1-496b-ad6b-a7c4cb430088" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-90c41813-ebf1-496b-ad6b-a7c4cb430088" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2804cf-af72-4d67-aaf6-db23a499900f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:27 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 Jul 05 18:32:27 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:27 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155" returned: 0 in 0.841s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] <== create_volume: return (2463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1970597464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2717b2f-5a60-4eea-a0dd-ae5053141203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:25Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Creating volume c2717b2f-5a60-4eea-a0dd-ae5053141203 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:32:27 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bebea31-3d66-4792-b5fc-967c3f78bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd436be-1eee-4127-919c-fdd81f9f6155', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:27 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 1073741824 Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26659f3-d607-4155-bcb7-5de253a7e3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:27 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:27 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume volume-1fd436be-1eee-4127-919c-fdd81f9f6155 (1fd436be-1eee-4127-919c-fdd81f9f6155): created successfully Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26659f3-d607-4155-bcb7-5de253a7e3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (f9ea8220-3bcb-42a3-89bd-3d3e462717e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-814dcdac-7710-445b-9052-a49fa780afb7 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created volume successfully. Jul 05 18:32:27 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b4ea75ac-351e-4bc4-96f8-a740d72b9089" returned: 0 in 0.862s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-quobyte-b4ea75ac-351e-4bc4-96f8-a740d72b9089" released by "delete_volume" :: held 2.250s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Created reservations ['f2694889-a450-4d36-b08d-5552d660ad8a', 'd4b6fba2-6280-463d-b0a1-8a61650aaa60', 'e81b58f4-709d-4968-861c-87dba8eb2482', '5968be34-4b3e-4ddd-a44a-a36024d19055'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:28 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:28 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:28 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088" returned: 0 in 1.015s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:28 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088 Jul 05 18:32:28 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:28 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 1073741824" returned: 0 in 1.077s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:28 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 Jul 05 18:32:28 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:28 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.774s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:28 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:28 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Deleted volume successfully. Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-473dc1c0-9f0c-43ed-bc5d-c89eb733f973 tempest-VolumesSnapshotListTestJSON-1089717927 None] Lock "cinder-b4ea75ac-351e-4bc4-96f8-a740d72b9089-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:29 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-90c41813-ebf1-496b-ad6b-a7c4cb430088" returned: 0 in 0.773s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-90c41813-ebf1-496b-ad6b-a7c4cb430088" released by "delete_volume" :: held 1.857s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Created reservations ['66e1f50c-c96b-41f6-b9e2-d5abab941eeb', '718e2167-2916-4568-8fe7-882941d06785', '88d0416a-3df9-4765-8d78-803f3b9a9cbd', '12e4079e-780a-49ec-a2b3-617874d92e84'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:29 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:29 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:29 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203" returned: 0 in 0.800s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.234s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-265195308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a996115-775f-4703-9238-99ade969e4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:26Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Creating volume 0a996115-775f-4703-9238-99ade969e4ce {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:32:29 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552f0be7-c147-4928-8e0e-dc82bf04ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2717b2f-5a60-4eea-a0dd-ae5053141203', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:29 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce 1073741824 Jul 05 18:32:29 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff4e851-487a-4a2c-9756-d4ce7d958b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-73d57173-7db1-45aa-ba03-bf1b3164db51-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:29 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 (c2717b2f-5a60-4eea-a0dd-ae5053141203): created successfully Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff4e851-487a-4a2c-9756-d4ce7d958b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (3e7ac8bd-2698-4838-a16a-72e8593666ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-73d57173-7db1-45aa-ba03-bf1b3164db51-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9cc94e6a-71f2-4e11-9f31-72fd38d76b71 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created volume successfully. Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "cinder-quobyte-73d57173-7db1-45aa-ba03-bf1b3164db51" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-73d57173-7db1-45aa-ba03-bf1b3164db51" acquired by "delete_volume" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc18d5c-3a95-49a7-8636-13d103656578]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:29 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 Jul 05 18:32:29 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:30 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.899s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:30 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Deleted volume successfully. Jul 05 18:32:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b8f9f745-2729-459c-9655-f823b6b07d3c tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-90c41813-ebf1-496b-ad6b-a7c4cb430088-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:30 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce 1073741824" returned: 0 in 1.250s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:30 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce Jul 05 18:32:30 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:30 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51" returned: 0 in 1.132s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:30 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51 Jul 05 18:32:30 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:31 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce" returned: 0 in 0.800s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.936s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-500652481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501ec7f2-431c-487a-a76c-07195dbcc054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:26Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Creating volume 501ec7f2-431c-487a-a76c-07195dbcc054 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:32:31 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b8e991-1912-4579-9d52-44136dd1eabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a996115-775f-4703-9238-99ade969e4ce', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:31 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054 1073741824 Jul 05 18:32:31 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5340f93-451e-47fb-b621-f48967905296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:31 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume volume-0a996115-775f-4703-9238-99ade969e4ce (0a996115-775f-4703-9238-99ade969e4ce): created successfully Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5340f93-451e-47fb-b621-f48967905296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (ff713009-3fb3-44c5-9f99-43ca4d422295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:31 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-73d57173-7db1-45aa-ba03-bf1b3164db51" returned: 0 in 0.793s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:31 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-501bf12e-2dfc-49a6-af1d-307475374977 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created volume successfully. Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-quobyte-73d57173-7db1-45aa-ba03-bf1b3164db51" released by "delete_volume" :: held 2.010s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Created reservations ['ae3b70e9-a516-4d6d-9364-7eb9484a8d33', '2e1ca4e8-9d55-44a6-9c13-275fea2aec0c', '3746053c-a2e7-487d-a3fa-07077c42721a', '4d469c06-d7cd-476a-ae80-f7cab6030750'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:31 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:31 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:32 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054 1073741824" returned: 0 in 1.126s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:32 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.891s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:32 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Deleted volume successfully. Jul 05 18:32:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-600b63f6-9c18-4d6b-bd08-fe836e64d138 tempest-VolumesSnapshotTestJSON-1886162574 None] Lock "cinder-73d57173-7db1-45aa-ba03-bf1b3164db51-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:32 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054 Jul 05 18:32:32 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:33 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054" returned: 0 in 0.790s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.430s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1808933074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73d1560e249d4fbf95fca2c1ec5b9ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:32:27Z,use_quota=True,user_id='0140fd21ce434958b02d18ab646a8f1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Creating volume 7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:32:33 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:33 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 1073741824 Jul 05 18:32:33 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e6eec7-9f76-4693-a5dd-2f1fdd696316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501ec7f2-431c-487a-a76c-07195dbcc054', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d47c3f-c2fc-43d8-be78-17c838b7592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume volume-501ec7f2-431c-487a-a76c-07195dbcc054 (501ec7f2-431c-487a-a76c-07195dbcc054): created successfully Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d47c3f-c2fc-43d8-be78-17c838b7592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (008702e7-87b7-4b9f-a59a-df2bb683c629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-bc19f2b4-4433-4842-8c26-7e15d9ee78d3 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created volume successfully. Jul 05 18:32:34 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 1073741824" returned: 0 in 1.045s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:34 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 Jul 05 18:32:34 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:35 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6" returned: 0 in 0.830s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:32:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7473476-7bf3-4dd3-9f01-9898f179ad98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed0f975-e3eb-47d5-844f-4f6b14b0f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:32:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Volume volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 (7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6): created successfully Jul 05 18:32:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed0f975-e3eb-47d5-844f-4f6b14b0f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:32:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Flow 'volume_create_manager' (ba91ad65-525d-4b8e-a757-b079a4db10b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:32:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-21498bad-ae94-41d9-952e-543be3eef2f0 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created volume successfully. Jul 05 18:32:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-quobyte-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:36 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3dfbcf-cfb8-4910-ad26-c24ba3ad10f7]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:36 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 Jul 05 18:32:36 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:37 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6" returned: 0 in 1.109s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:37 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6 Jul 05 18:32:37 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:38 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6" returned: 0 in 0.918s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6" released by "delete_volume" :: held 2.092s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created reservations ['d26c7f27-c68b-4500-afa5-b5e5d5bf3f7e', 'bb64a2b5-7dac-4c78-b3ab-fde3c4d63685', 'ee0860fb-600e-45ec-b039-99f00b2108ca', '68c607ba-6636-40c9-9603-deedab29e139'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:38 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:38 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-501ec7f2-431c-487a-a76c-07195dbcc054-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-501ec7f2-431c-487a-a76c-07195dbcc054-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-quobyte-501ec7f2-431c-487a-a76c-07195dbcc054" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-501ec7f2-431c-487a-a76c-07195dbcc054" acquired by "delete_volume" :: waited 0.026s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e6514b-0436-4885-b1c8-c8aa2440c12b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:38 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054 Jul 05 18:32:38 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:39 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.135s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:39 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Deleted volume successfully. Jul 05 18:32:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-730a096b-7fbd-41b9-9b48-6d34628572aa tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-7ab9d8c8-609a-4032-8be5-dbd8f01dc1a6-delete_volume" released by "delete_volume" :: held 3.528s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:40 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054" returned: 0 in 1.247s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:40 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054 Jul 05 18:32:40 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:41 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-501ec7f2-431c-487a-a76c-07195dbcc054" returned: 0 in 1.132s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-501ec7f2-431c-487a-a76c-07195dbcc054" released by "delete_volume" :: held 2.461s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:41 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created reservations ['29029f62-804c-4a33-97d0-dea1d8b9a53f', '4e6a7c32-aebb-42af-816c-d05d364d3bce', '06ba8a12-adc4-4321-8355-f849345d3926', 'e3cbb668-2ffa-4e99-857b-e8ef3bf65c3f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:41 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:41 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-0a996115-775f-4703-9238-99ade969e4ce-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-0a996115-775f-4703-9238-99ade969e4ce-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-quobyte-0a996115-775f-4703-9238-99ade969e4ce" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-0a996115-775f-4703-9238-99ade969e4ce" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:42 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b26794b-1583-4209-86cd-a6ec6cab7f94]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:42 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.094s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:42 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Deleted volume successfully. Jul 05 18:32:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-be63bb1d-dd95-486f-bee8-a0b574f07d00 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-501ec7f2-431c-487a-a76c-07195dbcc054-delete_volume" released by "delete_volume" :: held 3.959s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:42 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce Jul 05 18:32:42 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:43 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce" returned: 0 in 1.127s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:43 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce Jul 05 18:32:43 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:44 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0a996115-775f-4703-9238-99ade969e4ce" returned: 0 in 0.906s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-0a996115-775f-4703-9238-99ade969e4ce" released by "delete_volume" :: held 2.117s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:44 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created reservations ['b8b4bf4b-e742-4fbe-b7da-5d433f00d815', '1d3000ed-e328-4b6d-89db-26a8ee2a1347', '4ed01ac6-bd11-475c-8e8d-4b68b3d13cd9', '407b5545-784a-40ea-99bf-9888909b89b0'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:44 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:44 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:44 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:45 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.832s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:45 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Deleted volume successfully. Jul 05 18:32:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6aeee11-3937-473b-ad22-9001750c3c08 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-0a996115-775f-4703-9238-99ade969e4ce-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-c2717b2f-5a60-4eea-a0dd-ae5053141203-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-c2717b2f-5a60-4eea-a0dd-ae5053141203-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-quobyte-c2717b2f-5a60-4eea-a0dd-ae5053141203" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-c2717b2f-5a60-4eea-a0dd-ae5053141203" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:45 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea1a61c-c42a-4c30-be7a-6b4c20495382]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:45 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 Jul 05 18:32:45 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:46 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203" returned: 0 in 1.005s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:46 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203 Jul 05 18:32:46 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:47 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c2717b2f-5a60-4eea-a0dd-ae5053141203" returned: 0 in 0.728s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-c2717b2f-5a60-4eea-a0dd-ae5053141203" released by "delete_volume" :: held 1.809s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:47 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created reservations ['b480bb15-8554-49f8-89ee-7e58d42fa935', 'a82b556e-8d3f-49bc-a0db-d872c5f7114e', 'ac0bd001-43de-4786-aa03-f37281366c61', '42444921-3ec3-4e00-9be5-d76ce57cc6bf'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:47 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:47 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-1fd436be-1eee-4127-919c-fdd81f9f6155-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-1fd436be-1eee-4127-919c-fdd81f9f6155-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-quobyte-1fd436be-1eee-4127-919c-fdd81f9f6155" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-1fd436be-1eee-4127-919c-fdd81f9f6155" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:48 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6520d1-af08-42ed-a076-9c2e08a61182]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:48 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155 Jul 05 18:32:48 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:48 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.113s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:48 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Deleted volume successfully. Jul 05 18:32:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-241bb388-0b5e-4d91-929b-43cb8124daa6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-c2717b2f-5a60-4eea-a0dd-ae5053141203-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:49 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155" returned: 0 in 1.185s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:49 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155 Jul 05 18:32:49 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-1fd436be-1eee-4127-919c-fdd81f9f6155" returned: 0 in 0.790s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:50 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-1fd436be-1eee-4127-919c-fdd81f9f6155" released by "delete_volume" :: held 2.083s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:50 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created reservations ['733a17d0-d717-454e-b5f3-a869ee17b40d', '6d6dad33-c4f4-4969-befd-e349136b2184', 'd3b9d835-8d8e-49d2-9527-62b4006d1e3e', '53d9d310-dbdf-49b9-9c18-a0a23fd96ae5'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:50 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:50 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:50 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:50 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:51 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.766s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:32:51 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Deleted volume successfully. Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1a86fe85-d40c-43da-af99-49546fa9e279 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-1fd436be-1eee-4127-919c-fdd81f9f6155-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-f4ee3c40-4d29-4d73-b071-b4e240b40ead-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-f4ee3c40-4d29-4d73-b071-b4e240b40ead-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-quobyte-8ba3f847-11cb-4871-b2d7-2318f90389fd" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-8ba3f847-11cb-4871-b2d7-2318f90389fd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-quobyte-f4ee3c40-4d29-4d73-b071-b4e240b40ead" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-f4ee3c40-4d29-4d73-b071-b4e240b40ead" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Deleting offline snapshot f4ee3c40-4d29-4d73-b071-b4e240b40ead of volume 8ba3f847-11cb-4871-b2d7-2318f90389fd {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] snapshot_file for this snap is: volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea88d0b-8c84-43c5-842a-176101381bda]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:51 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead Jul 05 18:32:51 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:52 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead" returned: 0 in 0.983s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ba3f847-11cb-4871-b2d7-2318f90389fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:32:52 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83b04fa-d5dd-49b5-8ed1-be1f1d21c144]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:52 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd Jul 05 18:32:52 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:53 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd" returned: 0 in 1.176s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:53 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead Jul 05 18:32:53 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:54 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead" returned: 0 in 1.032s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:54 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead Jul 05 18:32:54 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:55 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd.f4ee3c40-4d29-4d73-b071-b4e240b40ead" returned: 0 in 0.858s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-f4ee3c40-4d29-4d73-b071-b4e240b40ead" released by "_delete_snapshot" :: held 4.226s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-8ba3f847-11cb-4871-b2d7-2318f90389fd" released by "delete_snapshot" :: held 4.262s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:55 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created reservations ['de16ff57-2af0-4124-a1c6-aa284e554e4f', '8ddc25a4-60f2-4627-b0eb-a38445bd0a6f', '2d326f9a-7797-44e6-b816-56d9a25ad327', '46f3fe9a-71ac-4f44-bb7a-c4363da9691b'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:55 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Delete snapshot completed successfully. Jul 05 18:32:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cc932e17-2c64-486f-b821-7883237b3a6f tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-f4ee3c40-4d29-4d73-b071-b4e240b40ead-delete_snapshot" released by "delete_snapshot" :: held 4.470s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-8ba3f847-11cb-4871-b2d7-2318f90389fd-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-8ba3f847-11cb-4871-b2d7-2318f90389fd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "cinder-quobyte-8ba3f847-11cb-4871-b2d7-2318f90389fd" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:32:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-8ba3f847-11cb-4871-b2d7-2318f90389fd" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:32:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b83b4c4-db99-4209-b67a-a76c72853d7b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:32:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:57 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd Jul 05 18:32:57 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:58 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd" returned: 0 in 1.114s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:58 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd Jul 05 18:32:58 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:32:59 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 05 18:32:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8ba3f847-11cb-4871-b2d7-2318f90389fd" returned: 0 in 0.921s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:32:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-quobyte-8ba3f847-11cb-4871-b2d7-2318f90389fd" released by "delete_volume" :: held 2.122s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:32:59 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Created reservations ['b2b957b4-00ad-40bb-8009-75530e7810c2', '1f75f490-b9c0-4962-823b-8e13fea5744a', 'bacd53b4-5672-4dc3-a3a3-f98ee2224f04', 'ca843ebf-03e4-49f1-a392-775c67f34062'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:32:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:32:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:32:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:32:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:32:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:32:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:32:59 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:32:59 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:00 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.876s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:00 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:33:00 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Deleted volume successfully. Jul 05 18:33:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-563f4c51-179e-4e5c-a5dd-71ada68733f6 tempest-CreateVolumesFromSnapshotTest-1916731293 None] Lock "cinder-8ba3f847-11cb-4871-b2d7-2318f90389fd-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (f96f8714-7fa8-46b9-af85-ed6db07a304e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b171c4-dd88-40c2-b0fc-4fd0f4a6325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b171c4-dd88-40c2-b0fc-4fd0f4a6325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422653957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6d8d82-0d55-4443-9cd4-e944912e9330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:06Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0553c2b0-d0de-4d48-9b0d-40eb5ddd5b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0553c2b0-d0de-4d48-9b0d-40eb5ddd5b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d9f670-d846-40b3-8231-ca332213bcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61d9f670-d846-40b3-8231-ca332213bcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6d8d82-0d55-4443-9cd4-e944912e9330', 'volume_name': 'volume-fb6d8d82-0d55-4443-9cd4-e944912e9330', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3494d251-fefb-4040-8dfd-3eb1834bbee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3494d251-fefb-4040-8dfd-3eb1834bbee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcee3837-c152-4d43-8a05-270d273b8339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:05 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume fb6d8d82-0d55-4443-9cd4-e944912e9330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6d8d82-0d55-4443-9cd4-e944912e9330', 'volume_size': 1} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1422653957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6d8d82-0d55-4443-9cd4-e944912e9330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:06Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Creating volume fb6d8d82-0d55-4443-9cd4-e944912e9330 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:05 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:06 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 1073741824 Jul 05 18:33:06 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Flow 'volume_create_manager' (43685e2d-f5bc-4bf5-8f19-e2b0ce54ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91261cf7-3058-483b-9e2e-cb9e9cf9a382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91261cf7-3058-483b-9e2e-cb9e9cf9a382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-75480417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db81850b-7e91-47a1-ac25-2b3e8808fc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b0ee58122417ab0580708a8d013df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:07Z,use_quota=True,user_id='2d0d892322b3495bba31bfee2c9ab7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c06391a-9565-487e-b9fd-01efc9dbb5cd),volume_type_id=4c06391a-9565-487e-b9fd-01efc9dbb5cd)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a14fbe-96d5-438b-bb41-6f24f8195170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a14fbe-96d5-438b-bb41-6f24f8195170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94885a45-417b-495e-86cc-5ae05358132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94885a45-417b-495e-86cc-5ae05358132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db81850b-7e91-47a1-ac25-2b3e8808fc0a', 'volume_name': 'volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ed2f44-601a-4ff2-be4c-709f029b92a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ed2f44-601a-4ff2-be4c-709f029b92a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8672730-a16e-4881-bc2e-fba6b1802619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:06 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Volume db81850b-7e91-47a1-ac25-2b3e8808fc0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a', 'volume_size': 1} Jul 05 18:33:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:07 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 1073741824" returned: 0 in 1.305s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:07 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 Jul 05 18:33:07 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Flow 'volume_create_manager' (db2420ff-f4d5-4718-b12e-fb1e078a05c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbb6490-6c25-4541-b04c-a39bd6194d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fbb6490-6c25-4541-b04c-a39bd6194d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1913816199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac9e526-7cb9-4cb1-b404-db1145789fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b0ee58122417ab0580708a8d013df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:07Z,use_quota=True,user_id='2d0d892322b3495bba31bfee2c9ab7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c943b7f-cc62-4bfa-a0e1-067f4054de1c),volume_type_id=9c943b7f-cc62-4bfa-a0e1-067f4054de1c)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bc91ac-25ca-44e5-bd3c-d8544e81cded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bc91ac-25ca-44e5-bd3c-d8544e81cded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9446865-e7dc-4cbe-aaf0-06158cb524b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9446865-e7dc-4cbe-aaf0-06158cb524b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac9e526-7cb9-4cb1-b404-db1145789fe9', 'volume_name': 'volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfba25b-f461-4c72-bfd5-4eff6f297e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfba25b-f461-4c72-bfd5-4eff6f297e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b9a4ba-001e-4c73-a8f3-f140de7888d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:07 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Volume 7ac9e526-7cb9-4cb1-b404-db1145789fe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9', 'volume_size': 1} Jul 05 18:33:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Flow 'volume_create_manager' (b932a08e-b7e9-493b-b188-2fec76c1267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896efaf7-7d5b-4ee7-8321-c7c1ec5a9a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896efaf7-7d5b-4ee7-8321-c7c1ec5a9a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-149709283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f280a1a7-dd78-4794-82dc-7e8dde7d944f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b0ee58122417ab0580708a8d013df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:08Z,use_quota=True,user_id='2d0d892322b3495bba31bfee2c9ab7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b27f939-63f8-44cc-840c-11179d5b2ae3),volume_type_id=0b27f939-63f8-44cc-840c-11179d5b2ae3)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:08 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2a3725-d866-43c8-ac59-7c79339e2439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2a3725-d866-43c8-ac59-7c79339e2439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb61e7f2-33e0-441f-9d91-560101f6faa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.image.glance [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Creating Keystone auth plugin from conf {{(pid=86664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330" returned: 0 in 1.087s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] <== create_volume: return (2443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.446s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-75480417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db81850b-7e91-47a1-ac25-2b3e8808fc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b0ee58122417ab0580708a8d013df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:07Z,use_quota=True,user_id='2d0d892322b3495bba31bfee2c9ab7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c06391a-9565-487e-b9fd-01efc9dbb5cd),volume_type_id=4c06391a-9565-487e-b9fd-01efc9dbb5cd)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Creating volume db81850b-7e91-47a1-ac25-2b3e8808fc0a {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:08 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:08 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a 1073741824 Jul 05 18:33:08 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcee3837-c152-4d43-8a05-270d273b8339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6d8d82-0d55-4443-9cd4-e944912e9330', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38ff11d-5cc7-483d-b733-a09c7b739554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:08 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 (fb6d8d82-0d55-4443-9cd4-e944912e9330): created successfully Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38ff11d-5cc7-483d-b733-a09c7b739554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (f96f8714-7fa8-46b9-af85-ed6db07a304e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:08 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-653955fb-6517-45d1-b8e9-ff8d9dca10df tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created volume successfully. Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb61e7f2-33e0-441f-9d91-560101f6faa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f280a1a7-dd78-4794-82dc-7e8dde7d944f', 'volume_name': 'volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f', 'volume_size': 1, 'image_id': '7b1a4160-46c3-481d-8f26-24ff8160a57b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b1a4160-46c3-481d-8f26-24ff8160a57b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1491226811', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b3b0ee58122417ab0580708a8d013df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b1a4160-46c3-481d-8f26-24ff8160a57b', 'created_at': datetime.datetime(2026, 7, 5, 16, 33, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 33, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b1a4160-46c3-481d-8f26-24ff8160a57b/file', 'properties': {}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411cfb8c-9998-42df-8e1b-9efaca596de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (411cfb8c-9998-42df-8e1b-9efaca596de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f64a71-d514-42be-97fe-bc9c6a7cff8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:09 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Volume f280a1a7-dd78-4794-82dc-7e8dde7d944f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f', 'volume_size': 1, 'image_id': '7b1a4160-46c3-481d-8f26-24ff8160a57b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b1a4160-46c3-481d-8f26-24ff8160a57b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1491226811', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b3b0ee58122417ab0580708a8d013df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b1a4160-46c3-481d-8f26-24ff8160a57b', 'created_at': datetime.datetime(2026, 7, 5, 16, 33, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 33, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b1a4160-46c3-481d-8f26-24ff8160a57b/file', 'properties': {}}, 'image_service': } Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Trying to clone f280a1a7-dd78-4794-82dc-7e8dde7d944f from image 7b1a4160-46c3-481d-8f26-24ff8160a57b at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b1a4160-46c3-481d-8f26-24ff8160a57b', 'metadata': {}}]). {{(pid=86664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 18:33:09 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a 1073741824" returned: 0 in 1.317s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:09 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a Jul 05 18:33:09 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (4af1b9cf-6742-4812-87ed-11122777a64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e4dbee-5920-43f2-9434-ac630c6e31fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e4dbee-5920-43f2-9434-ac630c6e31fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950428370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb86324a-99f9-4c28-901b-0d88e22a89ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:10Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bca047-019c-4fc3-942e-bc4ccf99783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bca047-019c-4fc3-942e-bc4ccf99783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8247da3a-0fa1-4970-ba1b-f934bd642a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8247da3a-0fa1-4970-ba1b-f934bd642a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb86324a-99f9-4c28-901b-0d88e22a89ae', 'volume_name': 'volume-bb86324a-99f9-4c28-901b-0d88e22a89ae', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3285969c-a7f3-4fc4-97b0-c3085a9d2289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3285969c-a7f3-4fc4-97b0-c3085a9d2289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35ca515-bd87-4882-968b-a4318d0d968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:10 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume bb86324a-99f9-4c28-901b-0d88e22a89ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb86324a-99f9-4c28-901b-0d88e22a89ae', 'volume_size': 1} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (a2edad81-0595-4701-b934-e89497525f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12b21c1-3680-4f53-81a0-370498277e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12b21c1-3680-4f53-81a0-370498277e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091066967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536bd061-56c9-4e4f-a5f5-e3ba7adc5ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:10Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805f28b9-4c8a-4f03-ac6d-e4e780369393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805f28b9-4c8a-4f03-ac6d-e4e780369393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bd8c3d-808e-4ffb-b004-ee4b357fa6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75bd8c3d-808e-4ffb-b004-ee4b357fa6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536bd061-56c9-4e4f-a5f5-e3ba7adc5ced', 'volume_name': 'volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1179e05-32d9-4a07-861e-2a1c2490c3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1179e05-32d9-4a07-861e-2a1c2490c3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc795f2-9055-4281-8a71-c63afb023bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:10 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume 536bd061-56c9-4e4f-a5f5-e3ba7adc5ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced', 'volume_size': 1} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:10 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a" returned: 0 in 1.100s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] <== create_volume: return (2478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.482s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.250s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1913816199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac9e526-7cb9-4cb1-b404-db1145789fe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b0ee58122417ab0580708a8d013df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:07Z,use_quota=True,user_id='2d0d892322b3495bba31bfee2c9ab7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c943b7f-cc62-4bfa-a0e1-067f4054de1c),volume_type_id=9c943b7f-cc62-4bfa-a0e1-067f4054de1c)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Creating volume 7ac9e526-7cb9-4cb1-b404-db1145789fe9 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:10 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:10 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:10 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 1073741824 Jul 05 18:33:10 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (40b11782-39aa-4361-9ef9-b189e2d37823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb8a86d-5f34-4e64-a8d1-a688f692eff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8672730-a16e-4881-bc2e-fba6b1802619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b12a1b5-0347-4bcf-8559-8d0980bf22bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb8a86d-5f34-4e64-a8d1-a688f692eff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1492795015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc5f348-4611-4213-a8c6-7d68752197e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:11Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034a9c6a-03ce-474b-a226-38ade03c8ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034a9c6a-03ce-474b-a226-38ade03c8ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986d6461-9489-41d5-8627-e550dff9cadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (986d6461-9489-41d5-8627-e550dff9cadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc5f348-4611-4213-a8c6-7d68752197e1', 'volume_name': 'volume-2cc5f348-4611-4213-a8c6-7d68752197e1', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34ad77b-5329-4e3e-85d4-22a3dc537b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34ad77b-5329-4e3e-85d4-22a3dc537b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a344e7b-b66d-472b-affa-0abbd3e93b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume 2cc5f348-4611-4213-a8c6-7d68752197e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc5f348-4611-4213-a8c6-7d68752197e1', 'volume_size': 1} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:11 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Volume volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a (db81850b-7e91-47a1-ac25-2b3e8808fc0a): created successfully Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b12a1b5-0347-4bcf-8559-8d0980bf22bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Flow 'volume_create_manager' (43685e2d-f5bc-4bf5-8f19-e2b0ce54ed81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:11 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-93a6c4b9-533e-4246-b295-15fdb8babe55 tempest-TestInstancesWithCinderVolumes-97965628 None] Created volume successfully. Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (a0379b84-6f9b-4f56-99e0-139ad732f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27568b43-88a6-404b-909f-31d7594070aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27568b43-88a6-404b-909f-31d7594070aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601833028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b80cf4-924c-4072-83c1-327c3df14e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:11Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960c4490-e44a-47f2-aa39-6fab62939f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (960c4490-e44a-47f2-aa39-6fab62939f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b0464f-c40f-4cd5-b000-fcad52d00ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b0464f-c40f-4cd5-b000-fcad52d00ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b80cf4-924c-4072-83c1-327c3df14e19', 'volume_name': 'volume-07b80cf4-924c-4072-83c1-327c3df14e19', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2168bac7-3acf-4f23-91e0-c0f9ad5232f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2168bac7-3acf-4f23-91e0-c0f9ad5232f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892442f7-87b7-45fa-8552-961adc6b4edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:11 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume 07b80cf4-924c-4072-83c1-327c3df14e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b80cf4-924c-4072-83c1-327c3df14e19', 'volume_size': 1} Jul 05 18:33:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:12 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:33:12 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (be072899-5e7e-40ec-8cdc-a21e4c988ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e941179-db17-4803-8416-53102e8d3130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e941179-db17-4803-8416-53102e8d3130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1978941589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b84e5df-cb4c-40c4-9744-2a0d1a888ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:12Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c67d674-e4ca-4f0b-b7fb-0a36b4925b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c67d674-e4ca-4f0b-b7fb-0a36b4925b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2980209-b798-4694-8f6f-4ef7fcbf095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2980209-b798-4694-8f6f-4ef7fcbf095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b84e5df-cb4c-40c4-9744-2a0d1a888ce3', 'volume_name': 'volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e38dc60-09cd-4753-8855-4f58fb3c84e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e38dc60-09cd-4753-8855-4f58fb3c84e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c07bdf-b4cb-4054-8ef4-e9db87c203ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:12 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume 0b84e5df-cb4c-40c4-9744-2a0d1a888ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3', 'volume_size': 1} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:12 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 1073741824" returned: 0 in 1.323s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:12 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 Jul 05 18:33:12 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:13 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.951s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:33:13 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9" returned: 0 in 0.802s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.108s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950428370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb86324a-99f9-4c28-901b-0d88e22a89ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:10Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Creating volume bb86324a-99f9-4c28-901b-0d88e22a89ae {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:13 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:13 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae 1073741824 Jul 05 18:33:13 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b9a4ba-001e-4c73-a8f3-f140de7888d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292c64d8-53e9-4f34-a409-3dc6df48247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:13 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Volume volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 (7ac9e526-7cb9-4cb1-b404-db1145789fe9): created successfully Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292c64d8-53e9-4f34-a409-3dc6df48247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Flow 'volume_create_manager' (db2420ff-f4d5-4718-b12e-fb1e078a05c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e3df0225-5bbd-4205-b6b6-12473fa8fa4c tempest-TestInstancesWithCinderVolumes-97965628 None] Created volume successfully. Jul 05 18:33:14 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae 1073741824" returned: 0 in 1.071s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:14 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae Jul 05 18:33:14 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:14 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD, size 20.69 MB, duration 5.95 sec {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 18:33:14 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Image download 20.69 MB at 3.48 MB/s Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[28326b4a-a23f-443f-bd2d-8be8dc31f40f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae" returned: 0 in 0.907s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.642s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091066967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536bd061-56c9-4e4f-a5f5-e3ba7adc5ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:10Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Creating volume 536bd061-56c9-4e4f-a5f5-e3ba7adc5ced {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:15 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:15 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:15 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD Jul 05 18:33:15 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35ca515-bd87-4882-968b-a4318d0d968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb86324a-99f9-4c28-901b-0d88e22a89ae', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:15 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced 1073741824 Jul 05 18:33:15 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a304f24-8096-4aef-8947-dc3cd35d35b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:15 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume volume-bb86324a-99f9-4c28-901b-0d88e22a89ae (bb86324a-99f9-4c28-901b-0d88e22a89ae): created successfully Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a304f24-8096-4aef-8947-dc3cd35d35b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (4af1b9cf-6742-4812-87ed-11122777a64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:15 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c7163d83-c5d7-4b31-9095-4d857d7be4e7 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created volume successfully. Jul 05 18:33:16 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD" returned: 0 in 0.991s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Temporary image 7b1a4160-46c3-481d-8f26-24ff8160a57b is fetched for user 2d0d892322b3495bba31bfee2c9ab7cc. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39236b2-1534-4348-869d-1765a580f8d9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:16 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD Jul 05 18:33:16 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:16 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced 1073741824" returned: 0 in 1.277s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:INSERT=38,cinder:UPDATE=144,cinder:SELECT=93,cinder:DELETE=13 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=112,cinder:INSERT=33,cinder:UPDATE=136,cinder:DELETE=8 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:16 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced Jul 05 18:33:16 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:16 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD" returned: 0 in 0.836s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:17 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced" returned: 0 in 0.766s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.207s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1492795015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc5f348-4611-4213-a8c6-7d68752197e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:11Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Creating volume 2cc5f348-4611-4213-a8c6-7d68752197e1 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:17 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc795f2-9055-4281-8a71-c63afb023bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:17 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1 1073741824 Jul 05 18:33:17 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a1cd81-bf0e-4436-853c-3fdb0ba0ef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:17 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced (536bd061-56c9-4e4f-a5f5-e3ba7adc5ced): created successfully Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a1cd81-bf0e-4436-853c-3fdb0ba0ef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (a2edad81-0595-4701-b934-e89497525f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-207a9470-b519-4298-9d51-c503053f391b tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created volume successfully. Jul 05 18:33:18 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1 1073741824" returned: 0 in 0.936s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:18 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1 Jul 05 18:33:18 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Flow 'volume_create_manager' (20909870-e210-498f-9762-ce63de82007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5f7849-0945-40aa-8672-6da55fa2edf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5f7849-0945-40aa-8672-6da55fa2edf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-939782433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e46a7d9-b853-49f6-a369-6edbdcdc057f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c359528936941de922b9efd14be7e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:18Z,use_quota=True,user_id='9677a02f2ef54795a26bf355e672b2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b7a16e-1105-4029-813a-1e78f6bd400d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28b7a16e-1105-4029-813a-1e78f6bd400d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83da587-052d-45c7-b910-888b93a72ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83da587-052d-45c7-b910-888b93a72ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e46a7d9-b853-49f6-a369-6edbdcdc057f', 'volume_name': 'volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2d11cd-f6d4-4177-b747-a3e6c412616a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2d11cd-f6d4-4177-b747-a3e6c412616a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63cfd3b-1323-4758-9748-f9caf85c7f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:18 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Volume 6e46a7d9-b853-49f6-a369-6edbdcdc057f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f', 'volume_size': 1} Jul 05 18:33:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:19 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1" returned: 0 in 0.767s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.521s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1601833028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b80cf4-924c-4072-83c1-327c3df14e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:11Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Creating volume 07b80cf4-924c-4072-83c1-327c3df14e19 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:19 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a344e7b-b66d-472b-affa-0abbd3e93b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc5f348-4611-4213-a8c6-7d68752197e1', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:19 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19 1073741824 Jul 05 18:33:19 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd4cc57-0061-4f32-8c05-ea889bc503e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:19 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume volume-2cc5f348-4611-4213-a8c6-7d68752197e1 (2cc5f348-4611-4213-a8c6-7d68752197e1): created successfully Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd4cc57-0061-4f32-8c05-ea889bc503e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (40b11782-39aa-4361-9ef9-b189e2d37823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:19 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3926a9bf-ea31-4520-9766-0f796cfbfb59 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created volume successfully. Jul 05 18:33:20 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19 1073741824" returned: 0 in 1.038s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:20 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19 Jul 05 18:33:20 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:21 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19" returned: 0 in 0.803s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.791s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1978941589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b84e5df-cb4c-40c4-9744-2a0d1a888ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee10b4f34c4446eae0b45770a92f57f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:12Z,use_quota=True,user_id='412f8a9f5c0b4d7d8afb3c67af2249af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Creating volume 0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:21 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892442f7-87b7-45fa-8552-961adc6b4edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b80cf4-924c-4072-83c1-327c3df14e19', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:21 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 1073741824 Jul 05 18:33:21 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a536a6f-0bb1-44f2-af8a-4d5eed431e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:21 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume volume-07b80cf4-924c-4072-83c1-327c3df14e19 (07b80cf4-924c-4072-83c1-327c3df14e19): created successfully Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a536a6f-0bb1-44f2-af8a-4d5eed431e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (a0379b84-6f9b-4f56-99e0-139ad732f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:21 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3c07cf7e-abd7-4e6a-b05c-6179ff827f97 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created volume successfully. Jul 05 18:33:21 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 1073741824" returned: 0 in 0.946s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:22 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 Jul 05 18:33:22 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:22 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3" returned: 0 in 0.630s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.728s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-149709283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f280a1a7-dd78-4794-82dc-7e8dde7d944f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3b0ee58122417ab0580708a8d013df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:08Z,use_quota=True,user_id='2d0d892322b3495bba31bfee2c9ab7cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b27f939-63f8-44cc-840c-11179d5b2ae3),volume_type_id=0b27f939-63f8-44cc-840c-11179d5b2ae3)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Creating volume f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:22 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:22 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f 1073741824 Jul 05 18:33:22 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c07bdf-b4cb-4054-8ef4-e9db87c203ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19fcab3-8a5c-47b7-a378-98fb9d8576aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:22 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Volume volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 (0b84e5df-cb4c-40c4-9744-2a0d1a888ce3): created successfully Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19fcab3-8a5c-47b7-a378-98fb9d8576aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:22 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Flow 'volume_create_manager' (be072899-5e7e-40ec-8cdc-a21e4c988ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1122ce4e-2b8f-40f5-9fef-c5602b51c4d6 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created volume successfully. Jul 05 18:33:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-quobyte-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:23 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[10af383e-d5ed-4bae-b6f9-a2e25dc4507c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:23 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 Jul 05 18:33:23 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:23 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f 1073741824" returned: 0 in 1.044s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:23 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f Jul 05 18:33:23 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:24 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3" returned: 0 in 0.940s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:24 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3 Jul 05 18:33:24 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:24 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f" returned: 0 in 0.793s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.949s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-939782433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e46a7d9-b853-49f6-a369-6edbdcdc057f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c359528936941de922b9efd14be7e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:18Z,use_quota=True,user_id='9677a02f2ef54795a26bf355e672b2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Creating volume 6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:24 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:24 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f 1073741824 Jul 05 18:33:24 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Attempting download of 7b1a4160-46c3-481d-8f26-24ff8160a57b ((None, [{'url': 'file:///opt/stack/data/glance/images/7b1a4160-46c3-481d-8f26-24ff8160a57b', 'metadata': {}}])) to volume f280a1a7-dd78-4794-82dc-7e8dde7d944f. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fe1ff7-df46-4a0d-9572-fa438bbd821c]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b1a4160-46c3-481d-8f26-24ff8160a57b_o4cfc04_ {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:24 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b1a4160-46c3-481d-8f26-24ff8160a57b_o4cfc04_ Jul 05 18:33:24 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:25 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3" returned: 0 in 0.832s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3" released by "delete_volume" :: held 1.832s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created reservations ['d5e3ec2f-52bb-4f8d-b839-9bca7df355b0', '0cf889b6-3fee-4128-b6ce-0f49fca557f4', 'f62c38f0-d060-44e2-8dc2-7ac0a42c6ec3', 'dee7dc74-2a18-4f71-91bd-83714ef0e815'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:25 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:33:25 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-07b80cf4-924c-4072-83c1-327c3df14e19-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-07b80cf4-924c-4072-83c1-327c3df14e19-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-quobyte-07b80cf4-924c-4072-83c1-327c3df14e19" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-07b80cf4-924c-4072-83c1-327c3df14e19" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10e2748-237c-41be-96f2-dc5fe9385f47]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:25 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:25 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f 1073741824" returned: 0 in 1.355s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b1a4160-46c3-481d-8f26-24ff8160a57b_o4cfc04_" returned: 0 in 1.226s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b1a4160-46c3-481d-8f26-24ff8160a57b_o4cfc04_ {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:26 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19 Jul 05 18:33:26 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:26 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f Jul 05 18:33:26 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:26 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b1a4160-46c3-481d-8f26-24ff8160a57b_o4cfc04_ Jul 05 18:33:26 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:26 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.204s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:26 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:33:26 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Deleted volume successfully. Jul 05 18:33:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2ef56517-663d-4129-91e5-061a03b61517 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-0b84e5df-cb4c-40c4-9744-2a0d1a888ce3-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:27 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f" returned: 0 in 1.264s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] <== create_volume: return (2737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.742s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63cfd3b-1323-4758-9748-f9caf85c7f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:27 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4678925-7541-468a-9047-b1a6be466983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b1a4160-46c3-481d-8f26-24ff8160a57b_o4cfc04_" returned: 1 in 1.396s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b1a4160-46c3-481d-8f26-24ff8160a57b_o4cfc04_' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf691576-d402-402b-b253-e5af89c3648d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:27 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Volume volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f (6e46a7d9-b853-49f6-a369-6edbdcdc057f): created successfully Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4678925-7541-468a-9047-b1a6be466983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Flow 'volume_create_manager' (20909870-e210-498f-9762-ce63de82007c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a6a7e18c-70b5-4faa-aba5-234243a07285 tempest-TestStampPattern-802381062 None] Created volume successfully. Jul 05 18:33:27 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD Jul 05 18:33:27 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:27 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19" returned: 0 in 1.824s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:27 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19 Jul 05 18:33:27 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:28 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD" returned: 0 in 1.070s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] 7b1a4160-46c3-481d-8f26-24ff8160a57b was qcow2, converting to raw {{(pid=86664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:28 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f Jul 05 18:33:28 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:28 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-07b80cf4-924c-4072-83c1-327c3df14e19" returned: 0 in 0.905s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-07b80cf4-924c-4072-83c1-327c3df14e19" released by "delete_volume" :: held 2.786s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created reservations ['b47308c7-8570-4097-81a9-34b56d591065', 'e8b585aa-c129-4a38-be70-5b8c09ef4ecd', 'ac665f83-d193-4c10-b6c0-f3c6df067d6e', '40752bbb-a786-4186-b279-a3f3ace2647e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:28 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:33:28 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-2cc5f348-4611-4213-a8c6-7d68752197e1-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-2cc5f348-4611-4213-a8c6-7d68752197e1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-quobyte-2cc5f348-4611-4213-a8c6-7d68752197e1" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-2cc5f348-4611-4213-a8c6-7d68752197e1" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:29 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d195b756-18e5-44a4-992c-88e1946462a8]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:29 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1 Jul 05 18:33:29 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:29 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.746s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:29 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:33:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Deleted volume successfully. Jul 05 18:33:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0b795e2e-5a52-4c20-998d-28e70584f07d tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-07b80cf4-924c-4072-83c1-327c3df14e19-delete_volume" released by "delete_volume" :: held 3.901s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:30 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1" returned: 0 in 0.966s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:30 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1 Jul 05 18:33:30 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:30 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f" returned: 0 in 2.323s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:30 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b1a4160-46c3-481d-8f26-24ff8160a57b_krbk2jc6devstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:33:30 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Converted 112.00 MB image at 48.16 MB/s Jul 05 18:33:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:30 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f 1G Jul 05 18:33:30 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:31 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cc5f348-4611-4213-a8c6-7d68752197e1" returned: 0 in 0.934s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-2cc5f348-4611-4213-a8c6-7d68752197e1" released by "delete_volume" :: held 1.956s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created reservations ['868d5671-8d93-49c9-9f32-21589dff4b29', '733b24b5-7479-4e2a-9058-cbef1bffc41d', '28c918e0-0687-47c7-bab0-cd883e0949d6', 'dc9c1e28-9cda-463b-b13a-ae7990cbd202'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:31 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:33:31 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-quobyte-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebc4f1c-965c-47e9-bd81-ad9baade5d89]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:31 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f 1G" returned: 0 in 0.791s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff49259-cdf6-46ba-b8da-c0d0981eb072]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:31 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced Jul 05 18:33:31 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:31 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f Jul 05 18:33:31 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:32 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.923s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:32 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:33:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Deleted volume successfully. Jul 05 18:33:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e340161e-03a5-49a6-b5c7-fb6ca0ab14f2 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-2cc5f348-4611-4213-a8c6-7d68752197e1-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:32 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced" returned: 0 in 1.188s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:32 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced Jul 05 18:33:32 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:32 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f" returned: 0 in 1.317s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:33 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f Jul 05 18:33:33 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:33 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced" returned: 0 in 0.743s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced" released by "delete_volume" :: held 1.981s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created reservations ['b4ae94a7-7d6e-41cb-8e63-4ee32437bba9', 'fe53ff13-a813-45f0-8b18-43e26aa67ae4', '4c83a155-7c42-4941-917f-91d2fa400e80', 'b1ebbf4e-4686-405a-9c75-0dd2587a5796'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:33 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:33:33 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:33 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f" returned: 1 in 1.007s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Downloaded image 7b1a4160-46c3-481d-8f26-24ff8160a57b ((None, [{'url': 'file:///opt/stack/data/glance/images/7b1a4160-46c3-481d-8f26-24ff8160a57b', 'metadata': {}}])) to volume f280a1a7-dd78-4794-82dc-7e8dde7d944f successfully. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Temporary image 7b1a4160-46c3-481d-8f26-24ff8160a57b for user 2d0d892322b3495bba31bfee2c9ab7cc is deleted. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Marking volume f280a1a7-dd78-4794-82dc-7e8dde7d944f as bootable. {{(pid=86664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Copying metadata from image 7b1a4160-46c3-481d-8f26-24ff8160a57b to f280a1a7-dd78-4794-82dc-7e8dde7d944f. {{(pid=86664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 18:33:33 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Creating volume glance metadata for volume f280a1a7-dd78-4794-82dc-7e8dde7d944f backed by image 7b1a4160-46c3-481d-8f26-24ff8160a57b with: {'image_id': '7b1a4160-46c3-481d-8f26-24ff8160a57b', 'image_name': 'tempest-scenario-img--1491226811', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f64a71-d514-42be-97fe-bc9c6a7cff8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f', 'volume_size': 1, 'image_id': '7b1a4160-46c3-481d-8f26-24ff8160a57b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b1a4160-46c3-481d-8f26-24ff8160a57b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1491226811', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b3b0ee58122417ab0580708a8d013df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b1a4160-46c3-481d-8f26-24ff8160a57b', 'created_at': datetime.datetime(2026, 7, 5, 16, 33, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 33, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b1a4160-46c3-481d-8f26-24ff8160a57b/file', 'properties': {}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764befc6-6aa1-4fcb-980c-efc35260b3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:34 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Volume volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f (f280a1a7-dd78-4794-82dc-7e8dde7d944f): created successfully Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764befc6-6aa1-4fcb-980c-efc35260b3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Flow 'volume_create_manager' (b932a08e-b7e9-493b-b188-2fec76c1267a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:34 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9f77d745-d62f-460e-9ca5-b57a990af906 tempest-TestInstancesWithCinderVolumes-97965628 None] Created volume successfully. Jul 05 18:33:34 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.725s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:33:34 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Deleted volume successfully. Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a03311d2-9a6b-4a53-918a-1bd74873855f tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-536bd061-56c9-4e4f-a5f5-e3ba7adc5ced-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-bb86324a-99f9-4c28-901b-0d88e22a89ae-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-bb86324a-99f9-4c28-901b-0d88e22a89ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-quobyte-bb86324a-99f9-4c28-901b-0d88e22a89ae" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-bb86324a-99f9-4c28-901b-0d88e22a89ae" acquired by "delete_volume" :: waited 0.031s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:35 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a96a975-4f2f-4dac-bbfd-9528ded8b1ee]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:35 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae Jul 05 18:33:35 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:36 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae" returned: 0 in 1.131s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:36 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae Jul 05 18:33:36 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:37 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb86324a-99f9-4c28-901b-0d88e22a89ae" returned: 0 in 1.089s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-bb86324a-99f9-4c28-901b-0d88e22a89ae" released by "delete_volume" :: held 2.280s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:37 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created reservations ['6782fd24-7836-427e-9046-91784eec310d', '13c31ea7-5730-48c8-ae93-d632693f51df', '467411d2-dd84-4158-9807-fb0b650caf92', 'fe9c0365-4f36-4eba-b49b-50f316791475'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:33:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:37 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:33:37 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:38 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-fb6d8d82-0d55-4443-9cd4-e944912e9330-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.909s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:38 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:33:38 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Deleted volume successfully. Jul 05 18:33:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-fb6d8d82-0d55-4443-9cd4-e944912e9330-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f11b9983-bd1f-432e-9b8a-4834be19ea8e tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-bb86324a-99f9-4c28-901b-0d88e22a89ae-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "cinder-quobyte-fb6d8d82-0d55-4443-9cd4-e944912e9330" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-fb6d8d82-0d55-4443-9cd4-e944912e9330" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4ef869-2328-4ac7-9f35-f3b5fda77e76]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:38 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 Jul 05 18:33:38 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:39 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330" returned: 0 in 1.016s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:39 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330 Jul 05 18:33:39 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:40 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-fb6d8d82-0d55-4443-9cd4-e944912e9330" returned: 0 in 0.914s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-quobyte-fb6d8d82-0d55-4443-9cd4-e944912e9330" released by "delete_volume" :: held 1.986s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:40 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Created reservations ['63ae89b2-fb17-4c26-92f5-d12c21090678', '19f58e81-993c-458a-a6f4-7735f11ac0e6', '40fd750d-4f21-466c-8228-329f575800f3', 'bb2b6e5b-3c31-4bb3-8ce5-db6818968cf0'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:33:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:40 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:33:40 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:41 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.358s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:41 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:33:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Deleted volume successfully. Jul 05 18:33:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-777bd3f1-1577-4380-a160-85f23fd52387 tempest-CreateVolumesFromSourceVolumeTest-1055028787 None] Lock "cinder-fb6d8d82-0d55-4443-9cd4-e944912e9330-delete_volume" released by "delete_volume" :: held 3.655s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:33:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:42 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e6d6ea-bd44-4420-8839-9d81262a2758]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:43 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f Jul 05 18:33:43 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:44 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f" returned: 0 in 1.562s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:44 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f Jul 05 18:33:44 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:45 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f" returned: 1 in 0.998s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:33:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.647s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e7f61a4-a9b7-4111-afeb-0308441fcd60', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:33:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-d13291b5-a782-4c3a-878f-5f4cd58539e8 req-a63d394a-eb10-4e9b-bc0a-442995c05b80 tempest-TestInstancesWithCinderVolumes-97965628 None] attachment_update completed successfully. Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Flow 'volume_create_manager' (1d09ed9e-8348-4ef7-af7a-a52a65b37916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951ae51d-9e0e-460d-84ca-43b2e7aa8560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951ae51d-9e0e-460d-84ca-43b2e7aa8560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1092590121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d2a10a-a5af-4949-ab78-23d75723a807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e392d13622749f2bee8a2e290ba1245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:46Z,use_quota=True,user_id='64fb4aa91f1a435cac230e8541404e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bcea96-0002-4317-8fa9-718ee584479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bcea96-0002-4317-8fa9-718ee584479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ac9830-75a6-4310-ab13-cd2472e47ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ac9830-75a6-4310-ab13-cd2472e47ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d2a10a-a5af-4949-ab78-23d75723a807', 'volume_name': 'volume-85d2a10a-a5af-4949-ab78-23d75723a807', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf73b46-31c3-45e9-ad90-7e59803e9d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf73b46-31c3-45e9-ad90-7e59803e9d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e08d7e1-5d28-4e85-a6bf-2bc7455e8f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:46 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Volume 85d2a10a-a5af-4949-ab78-23d75723a807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d2a10a-a5af-4949-ab78-23d75723a807', 'volume_size': 1} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1092590121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d2a10a-a5af-4949-ab78-23d75723a807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e392d13622749f2bee8a2e290ba1245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:46Z,use_quota=True,user_id='64fb4aa91f1a435cac230e8541404e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Creating volume 85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:46 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:33:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:46 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 1073741824 Jul 05 18:33:46 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:47 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 1073741824" returned: 0 in 1.081s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:47 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 Jul 05 18:33:47 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:48 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807" returned: 0 in 0.711s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:33:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e08d7e1-5d28-4e85-a6bf-2bc7455e8f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d2a10a-a5af-4949-ab78-23d75723a807', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970ce6dc-ad43-4179-a4cf-5c1964f12f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:48 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Volume volume-85d2a10a-a5af-4949-ab78-23d75723a807 (85d2a10a-a5af-4949-ab78-23d75723a807): created successfully Jul 05 18:33:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (970ce6dc-ad43-4179-a4cf-5c1964f12f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Flow 'volume_create_manager' (1d09ed9e-8348-4ef7-af7a-a52a65b37916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f08fa971-3696-4b5c-adf3-a900a94a84ba tempest-VolumeDependencyTests-1244217481 None] Created volume successfully. Jul 05 18:33:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Creating offline snapshot d3f10a46-ec9a-4e13-bae5-fdca259d5370 of volume 85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:33:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0992c708-0aa8-4d31-b378-6fcbbbf17086]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:49 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 Jul 05 18:33:49 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:50 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807" returned: 0 in 0.851s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:50 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 1G Jul 05 18:33:50 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:51 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 1G" returned: 0 in 0.966s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85d2a10a-a5af-4949-ab78-23d75723a807 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:51 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85d2a10a-a5af-4949-ab78-23d75723a807 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 Jul 05 18:33:51 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:52 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85d2a10a-a5af-4949-ab78-23d75723a807 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370" returned: 0 in 0.731s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:52 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 is being set with open permissions: ugo+rw Jul 05 18:33:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:52 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 Jul 05 18:33:52 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:52 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370" returned: 0 in 0.712s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:52 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.info Jul 05 18:33:52 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:53 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.info" returned: 0 in 0.849s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:53 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.info is being set with open permissions: ugo+rw Jul 05 18:33:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:53 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.info Jul 05 18:33:53 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:54 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.info" returned: 0 in 0.896s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.165s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7ec5d7b6-b485-418a-a617-4ea63f241ff0 tempest-VolumeDependencyTests-1244217481 None] Create snapshot completed successfully Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Flow 'volume_create_manager' (6daa9f86-9e42-4d76-be71-2048de62ef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80197fb-6804-4ae3-a860-7800e7939887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80197fb-6804-4ae3-a860-7800e7939887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1746048617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a224f82-96a3-47c6-a98a-3aa89a77234e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e392d13622749f2bee8a2e290ba1245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d3f10a46-ec9a-4e13-bae5-fdca259d5370,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:33:55Z,use_quota=True,user_id='64fb4aa91f1a435cac230e8541404e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185f1b6a-af0b-4e30-9bae-071ba7d7dc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (185f1b6a-af0b-4e30-9bae-071ba7d7dc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8b7305-9d08-4080-87a5-b6154248b0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8b7305-9d08-4080-87a5-b6154248b0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a224f82-96a3-47c6-a98a-3aa89a77234e', 'volume_name': 'volume-5a224f82-96a3-47c6-a98a-3aa89a77234e', 'volume_size': 1, 'snapshot_id': 'd3f10a46-ec9a-4e13-bae5-fdca259d5370'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5285b643-713b-4a22-b469-dfcdca4dee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5285b643-713b-4a22-b469-dfcdca4dee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4900a72-1f0e-474b-831f-3eb582acaf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:33:55 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Volume 5a224f82-96a3-47c6-a98a-3aa89a77234e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a224f82-96a3-47c6-a98a-3aa89a77234e', 'volume_size': 1, 'snapshot_id': 'd3f10a46-ec9a-4e13-bae5-fdca259d5370'} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "cinder-quobyte-d3f10a46-ec9a-4e13-bae5-fdca259d5370-5a224f82-96a3-47c6-a98a-3aa89a77234e" by "_create_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-d3f10a46-ec9a-4e13-bae5-fdca259d5370-5a224f82-96a3-47c6-a98a-3aa89a77234e" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Creating volume 5a224f82-96a3-47c6-a98a-3aa89a77234e from snapshot d3f10a46-ec9a-4e13-bae5-fdca259d5370 {{(pid=86664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "cinder-quobyte-5a224f82-96a3-47c6-a98a-3aa89a77234e" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-5a224f82-96a3-47c6-a98a-3aa89a77234e" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] snapshot: d3f10a46-ec9a-4e13-bae5-fdca259d5370, volume: 5a224f82-96a3-47c6-a98a-3aa89a77234e, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2bd134-d5d2-45d6-84b9-f83eafd81906]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:55 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 Jul 05 18:33:55 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:56 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370" returned: 0 in 1.036s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85d2a10a-a5af-4949-ab78-23d75723a807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:33:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:33:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:33:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8f1602-e5db-4ae5-a57c-8912bdae1e62]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:33:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:57 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 Jul 05 18:33:57 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:33:57 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 05 18:33:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807" returned: 0 in 1.079s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:33:57 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:33:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:33:58 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e Jul 05 18:33:58 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-7fd51b65-df67-4c79-972d-dcf6ef176688 req-4552f479-dba5-49c6-a989-7171c2127891 tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:05 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e" returned: 0 in 7.342s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:05 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[490b1df2-6b90-45ff-8ba2-53078c935285]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:05 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 Jul 05 18:34:05 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:06 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807" returned: 0 in 0.937s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:34:06 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Converted 1024.00 MB image at 139.45 MB/s Jul 05 18:34:06 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e is being set with open permissions: ugo+rw Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:06 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e Jul 05 18:34:06 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:06 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e" returned: 0 in 0.649s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-5a224f82-96a3-47c6-a98a-3aa89a77234e" released by "_copy_volume_from_snapshot" :: held 11.156s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-d3f10a46-ec9a-4e13-bae5-fdca259d5370-5a224f82-96a3-47c6-a98a-3aa89a77234e" released by "_create_volume_from_snapshot" :: held 11.200s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.223s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-7fd51b65-df67-4c79-972d-dcf6ef176688 req-4552f479-dba5-49c6-a989-7171c2127891 tempest-TestStampPattern-802381062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.094s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4d0699-533f-44d6-8934-7a151385084d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-7fd51b65-df67-4c79-972d-dcf6ef176688 req-4552f479-dba5-49c6-a989-7171c2127891 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4900a72-1f0e-474b-831f-3eb582acaf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a224f82-96a3-47c6-a98a-3aa89a77234e', 'volume_size': 1, 'snapshot_id': 'd3f10a46-ec9a-4e13-bae5-fdca259d5370'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ab85ab-d4c6-4ca7-b4b5-56f9adfd3819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:07 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Volume volume-5a224f82-96a3-47c6-a98a-3aa89a77234e (5a224f82-96a3-47c6-a98a-3aa89a77234e): created successfully Jul 05 18:34:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ab85ab-d4c6-4ca7-b4b5-56f9adfd3819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Flow 'volume_create_manager' (6daa9f86-9e42-4d76-be71-2048de62ef63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-adb76102-f8da-4e90-b7cf-36ec362fe37c tempest-VolumeDependencyTests-1244217481 None] Created volume successfully. Jul 05 18:34:07 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f Jul 05 18:34:07 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:07 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-7fd51b65-df67-4c79-972d-dcf6ef176688 req-4552f479-dba5-49c6-a989-7171c2127891 tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f" returned: 0 in 0.816s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-7fd51b65-df67-4c79-972d-dcf6ef176688 req-4552f479-dba5-49c6-a989-7171c2127891 tempest-TestStampPattern-802381062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-7fd51b65-df67-4c79-972d-dcf6ef176688 req-4552f479-dba5-49c6-a989-7171c2127891 tempest-TestStampPattern-802381062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '989b2566-af16-40f1-85cb-1ec005a394c4', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:34:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-7fd51b65-df67-4c79-972d-dcf6ef176688 req-4552f479-dba5-49c6-a989-7171c2127891 tempest-TestStampPattern-802381062 None] attachment_update completed successfully. Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "cinder-d3f10a46-ec9a-4e13-bae5-fdca259d5370-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-d3f10a46-ec9a-4e13-bae5-fdca259d5370-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "cinder-quobyte-85d2a10a-a5af-4949-ab78-23d75723a807" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-85d2a10a-a5af-4949-ab78-23d75723a807" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "cinder-quobyte-d3f10a46-ec9a-4e13-bae5-fdca259d5370" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-d3f10a46-ec9a-4e13-bae5-fdca259d5370" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Deleting offline snapshot d3f10a46-ec9a-4e13-bae5-fdca259d5370 of volume 85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] snapshot_file for this snap is: volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c43828-17d4-4040-8d5a-45ad220c1c62]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:08 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 Jul 05 18:34:08 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:09 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370" returned: 0 in 1.051s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85d2a10a-a5af-4949-ab78-23d75723a807(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:34:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d3b6d2-02f3-45c7-aafb-da6e7f3fe28e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:09 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 Jul 05 18:34:09 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:10 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807" returned: 0 in 0.808s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:10 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 Jul 05 18:34:10 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:11 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370" returned: 0 in 0.901s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:11 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370 Jul 05 18:34:11 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:12 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807.d3f10a46-ec9a-4e13-bae5-fdca259d5370" returned: 0 in 0.691s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-d3f10a46-ec9a-4e13-bae5-fdca259d5370" released by "_delete_snapshot" :: held 3.595s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-85d2a10a-a5af-4949-ab78-23d75723a807" released by "delete_snapshot" :: held 3.630s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:12 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:34:12 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Created reservations ['feca476c-1f9b-494e-884b-702fbc962e3b', '5611c696-6155-424b-82f7-b97d6cc2c86f', '6bffa02c-4c3f-4713-9a88-1d4bada072dc', '1c51208d-9181-40b3-9494-0f957cea4eb7'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:34:12 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Delete snapshot completed successfully. Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b732e08-8780-4762-861d-d672fe94b816 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-d3f10a46-ec9a-4e13-bae5-fdca259d5370-delete_snapshot" released by "delete_snapshot" :: held 3.823s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "cinder-85d2a10a-a5af-4949-ab78-23d75723a807-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-85d2a10a-a5af-4949-ab78-23d75723a807-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "cinder-quobyte-85d2a10a-a5af-4949-ab78-23d75723a807" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-85d2a10a-a5af-4949-ab78-23d75723a807" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[36219814-a551-4aa6-8346-183420f57621]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:12 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.797s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:34:12 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 Jul 05 18:34:12 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:34:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:34:13 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807" returned: 0 in 0.869s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:13 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807 Jul 05 18:34:13 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:14 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-85d2a10a-a5af-4949-ab78-23d75723a807" returned: 0 in 0.786s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-85d2a10a-a5af-4949-ab78-23d75723a807" released by "delete_volume" :: held 1.738s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Created reservations ['4ac207b0-43b8-4130-b3e5-b51b337c92b1', 'ab4037f6-814a-46ee-9eb4-6ea1f6a9d521', '1a1651ad-b2aa-4b2a-8d50-3c3691632150', 'ecbf46a6-795a-4741-8749-ed31ff18ca2c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:14 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:34:14 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "cinder-5a224f82-96a3-47c6-a98a-3aa89a77234e-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-5a224f82-96a3-47c6-a98a-3aa89a77234e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "cinder-quobyte-5a224f82-96a3-47c6-a98a-3aa89a77234e" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-5a224f82-96a3-47c6-a98a-3aa89a77234e" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:15 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bebd16-27dd-48e2-a7d9-5ec7c1dd244d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:15 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e Jul 05 18:34:15 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:15 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.758s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:15 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:34:15 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Deleted volume successfully. Jul 05 18:34:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-231d0248-ebf6-48c5-a0e9-311933a66b74 tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-85d2a10a-a5af-4949-ab78-23d75723a807-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:15 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e" returned: 0 in 0.861s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:15 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e Jul 05 18:34:15 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:16 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a224f82-96a3-47c6-a98a-3aa89a77234e" returned: 0 in 0.755s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-quobyte-5a224f82-96a3-47c6-a98a-3aa89a77234e" released by "delete_volume" :: held 1.659s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=79,cinder:DELETE=10,cinder:INSERT=26,cinder:SELECT=71 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=75,cinder:INSERT=22,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Created reservations ['142a917e-358d-48f2-8ae2-c1150c3511e8', 'c9933ba5-543d-4bff-ad83-2795c6c870c6', '4fcfb3ba-329a-4b10-b703-698e463c99cd', '799f073c-e0c5-4f0e-a404-df5ecd4a3d17'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:16 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:34:16 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-cabac712-e260-4eea-80e6-1ee97fd8adef req-bd6557ec-33d0-4d83-81f7-6562cc07936b tempest-TestStampPattern-802381062 None] Terminate volume connection completed successfully. Jul 05 18:34:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-cabac712-e260-4eea-80e6-1ee97fd8adef req-bd6557ec-33d0-4d83-81f7-6562cc07936b tempest-TestStampPattern-802381062 None] Deleting attachment 989b2566-af16-40f1-85cb-1ec005a394c4. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:34:17 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.852s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:17 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:34:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Deleted volume successfully. Jul 05 18:34:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b53a0ae7-43f3-4e85-8fc7-a5a96c02d23e tempest-VolumeDependencyTests-1244217481 None] Lock "cinder-5a224f82-96a3-47c6-a98a-3aa89a77234e-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Creating offline snapshot 9d8a83df-4733-4028-bd23-00b2a5dd9f16 of volume 6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:34:19 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4efdfa2-89ff-416d-87c2-38dcacf32446]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:20 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f Jul 05 18:34:20 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:20 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f" returned: 0 in 0.887s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:20 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 1G Jul 05 18:34:20 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:21 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 1G" returned: 0 in 0.878s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:21 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 Jul 05 18:34:21 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Flow 'volume_create_manager' (5babb63c-5d4b-4af2-852a-47d2c83f6806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5feb10df-509d-4b97-a181-1117e390667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5feb10df-509d-4b97-a181-1117e390667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248494433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041bb647-b22e-4e7a-accd-efc12e0b5a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f5c999530949afa529ef761b7d6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:34:22Z,use_quota=True,user_id='75496985c9294d74b13fb3ad4a4ad8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66667257-9a74-482d-8b9e-7951dc21447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66667257-9a74-482d-8b9e-7951dc21447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9f9ef3-6bcf-4c7e-ad63-b16f79d657ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9f9ef3-6bcf-4c7e-ad63-b16f79d657ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '041bb647-b22e-4e7a-accd-efc12e0b5a0d', 'volume_name': 'volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b239b19-99a1-43c8-9c76-c0edd8039273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b239b19-99a1-43c8-9c76-c0edd8039273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd9894f-dab7-4e9c-89ee-aa80fb77bb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:21 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Volume 041bb647-b22e-4e7a-accd-efc12e0b5a0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d', 'volume_size': 1} Jul 05 18:34:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:22 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16" returned: 0 in 0.691s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:22 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 is being set with open permissions: ugo+rw Jul 05 18:34:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:22 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 Jul 05 18:34:22 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:23 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16" returned: 0 in 0.671s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:23 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.info Jul 05 18:34:23 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:23 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.info" returned: 0 in 0.698s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:23 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.info is being set with open permissions: ugo+rw Jul 05 18:34:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:23 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.info Jul 05 18:34:23 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:24 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.info" returned: 0 in 0.651s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.597s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.460s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-248494433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041bb647-b22e-4e7a-accd-efc12e0b5a0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f5c999530949afa529ef761b7d6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:34:22Z,use_quota=True,user_id='75496985c9294d74b13fb3ad4a4ad8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Creating volume 041bb647-b22e-4e7a-accd-efc12e0b5a0d {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:34:24 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:34:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:24 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d 1073741824 Jul 05 18:34:24 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:24 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-05d70cd0-f21b-44a1-b006-636772aed497 tempest-TestStampPattern-802381062 None] Create snapshot completed successfully Jul 05 18:34:25 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d 1073741824" returned: 0 in 0.963s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:25 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d Jul 05 18:34:25 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:26 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d" returned: 0 in 0.772s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd9894f-dab7-4e9c-89ee-aa80fb77bb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea030218-53d3-4bcb-a507-4588157c3890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:26 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Volume volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d (041bb647-b22e-4e7a-accd-efc12e0b5a0d): created successfully Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea030218-53d3-4bcb-a507-4588157c3890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Flow 'volume_create_manager' (5babb63c-5d4b-4af2-852a-47d2c83f6806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:26 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0e4c7873-0ece-4297-9643-712dde4f8a49 tempest-ProjectReaderTests-1091167357 None] Created volume successfully. Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-679ffb1f-8e77-4f13-ac7b-dc1b1dde50a0 req-9408bc0e-52e6-4bda-af85-5553981ed582 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-679ffb1f-8e77-4f13-ac7b-dc1b1dde50a0 req-9408bc0e-52e6-4bda-af85-5553981ed582 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea35c91e-b432-4ba3-a400-13098a25ccc7]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-679ffb1f-8e77-4f13-ac7b-dc1b1dde50a0 req-9408bc0e-52e6-4bda-af85-5553981ed582 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:26 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a Jul 05 18:34:26 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:27 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-679ffb1f-8e77-4f13-ac7b-dc1b1dde50a0 req-9408bc0e-52e6-4bda-af85-5553981ed582 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a" returned: 0 in 0.792s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-679ffb1f-8e77-4f13-ac7b-dc1b1dde50a0 req-9408bc0e-52e6-4bda-af85-5553981ed582 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-679ffb1f-8e77-4f13-ac7b-dc1b1dde50a0 req-9408bc0e-52e6-4bda-af85-5553981ed582 tempest-TestInstancesWithCinderVolumes-97965628 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c30bd617-8082-40ae-ab65-64b4a835efd7', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:34:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-679ffb1f-8e77-4f13-ac7b-dc1b1dde50a0 req-9408bc0e-52e6-4bda-af85-5553981ed582 tempest-TestInstancesWithCinderVolumes-97965628 None] attachment_update completed successfully. Jul 05 18:34:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "cinder-041bb647-b22e-4e7a-accd-efc12e0b5a0d-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-041bb647-b22e-4e7a-accd-efc12e0b5a0d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "cinder-quobyte-041bb647-b22e-4e7a-accd-efc12e0b5a0d" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-quobyte-041bb647-b22e-4e7a-accd-efc12e0b5a0d" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c97acdb-67fb-46db-a508-533721dcfe2d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:27 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d Jul 05 18:34:27 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:28 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d" returned: 0 in 0.915s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:28 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d Jul 05 18:34:28 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:29 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-041bb647-b22e-4e7a-accd-efc12e0b5a0d" returned: 0 in 0.677s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-quobyte-041bb647-b22e-4e7a-accd-efc12e0b5a0d" released by "delete_volume" :: held 1.636s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Created reservations ['b0041de0-453d-4df6-a686-abe48fc1e945', 'f03ad472-eff8-4cf4-a160-214799ef3421', '3425e470-5589-4a99-aa5e-b5281bd6db4b', '605f16fb-ab14-4186-b909-e16d47383da0'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:29 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:34:29 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:29 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.778s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:29 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:34:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Deleted volume successfully. Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b26cbd41-e255-4f67-a103-01a232eae642 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-041bb647-b22e-4e7a-accd-efc12e0b5a0d-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Flow 'volume_create_manager' (7fdba730-65ba-4fd0-8ee0-f09793b98a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2403e59a-55fc-4cf3-b8ef-de610c55ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2403e59a-55fc-4cf3-b8ef-de610c55ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-984223148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68dfb282-2cc0-44b7-970d-0ba24d73e55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f5c999530949afa529ef761b7d6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:34:30Z,use_quota=True,user_id='75496985c9294d74b13fb3ad4a4ad8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fc595f-8bba-46e0-abf3-f628423bee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15fc595f-8bba-46e0-abf3-f628423bee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7205c96a-f28b-40d9-8513-edf940f8eec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7205c96a-f28b-40d9-8513-edf940f8eec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68dfb282-2cc0-44b7-970d-0ba24d73e55e', 'volume_name': 'volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c376a51c-f841-4ec2-8671-d80a41f556dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c376a51c-f841-4ec2-8671-d80a41f556dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10efda9f-c41f-451d-a594-037da37df6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:30 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Volume 68dfb282-2cc0-44b7-970d-0ba24d73e55e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e', 'volume_size': 1} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-984223148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68dfb282-2cc0-44b7-970d-0ba24d73e55e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f5c999530949afa529ef761b7d6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:34:30Z,use_quota=True,user_id='75496985c9294d74b13fb3ad4a4ad8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Creating volume 68dfb282-2cc0-44b7-970d-0ba24d73e55e {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:34:30 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:34:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:30 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e 1073741824 Jul 05 18:34:30 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:31 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e 1073741824" returned: 0 in 0.942s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:31 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e Jul 05 18:34:31 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:32 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e" returned: 0 in 0.743s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10efda9f-c41f-451d-a594-037da37df6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad94470a-0149-4391-8951-08d88de8dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:32 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Volume volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e (68dfb282-2cc0-44b7-970d-0ba24d73e55e): created successfully Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad94470a-0149-4391-8951-08d88de8dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Flow 'volume_create_manager' (7fdba730-65ba-4fd0-8ee0-f09793b98a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4291e275-5e22-4d5c-93bd-4a56be224cf6 tempest-ProjectReaderTests-1091167357 None] Created volume successfully. Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Acquiring lock "cinder-68dfb282-2cc0-44b7-970d-0ba24d73e55e-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Lock "cinder-68dfb282-2cc0-44b7-970d-0ba24d73e55e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Acquiring lock "cinder-quobyte-68dfb282-2cc0-44b7-970d-0ba24d73e55e" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Lock "cinder-quobyte-68dfb282-2cc0-44b7-970d-0ba24d73e55e" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ea964-4500-4bd7-bfbf-c401e07ff33f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:32 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e Jul 05 18:34:32 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:33 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e" returned: 0 in 0.782s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:33 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e Jul 05 18:34:33 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:34 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-68dfb282-2cc0-44b7-970d-0ba24d73e55e" returned: 0 in 0.814s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Lock "cinder-quobyte-68dfb282-2cc0-44b7-970d-0ba24d73e55e" released by "delete_volume" :: held 1.635s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:34 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Created reservations ['863a8643-2197-4ab5-b4ed-c7ef7cd8983e', 'f8021ddb-61af-4f9a-80cd-909c027a8ddc', 'dcfd26ca-78b9-4395-a478-c466c35b1e5c', '3359885a-43ed-4fdc-80ec-58567e622882'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:34:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:34 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:34:34 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:35 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.911s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:34:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Deleted volume successfully. Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-b43d42de-096c-49c5-8d52-b70a60fcc85c req-702bf571-7fe2-464d-b2f5-ad343eaddb40 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-b43d42de-096c-49c5-8d52-b70a60fcc85c req-702bf571-7fe2-464d-b2f5-ad343eaddb40 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-176bcf23-e7c5-49be-82ac-301ca188dc7d tempest-ProjectReaderTests-1091167357 None] Lock "cinder-68dfb282-2cc0-44b7-970d-0ba24d73e55e-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4d7a2c-5327-4536-91fb-b082eefa45a9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-b43d42de-096c-49c5-8d52-b70a60fcc85c req-702bf571-7fe2-464d-b2f5-ad343eaddb40 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:35 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 Jul 05 18:34:35 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Flow 'volume_create_manager' (5b062592-ae85-49f9-868e-3a385045206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c11e918-a22e-44ab-bfb1-994eb75bdcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c11e918-a22e-44ab-bfb1-994eb75bdcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1299721634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e79963-0b09-4c06-a0e8-393737329111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c359528936941de922b9efd14be7e6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d8a83df-4733-4028-bd23-00b2a5dd9f16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:34:36Z,use_quota=True,user_id='9677a02f2ef54795a26bf355e672b2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9743b220-3047-469a-8768-f935482bf47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9743b220-3047-469a-8768-f935482bf47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851c9d31-1adc-4fdd-b792-dc1c9404c9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851c9d31-1adc-4fdd-b792-dc1c9404c9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26e79963-0b09-4c06-a0e8-393737329111', 'volume_name': 'volume-26e79963-0b09-4c06-a0e8-393737329111', 'volume_size': 1, 'snapshot_id': '9d8a83df-4733-4028-bd23-00b2a5dd9f16'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68850f20-7ca7-443e-8d28-23e947f8a3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68850f20-7ca7-443e-8d28-23e947f8a3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034a42f9-52d4-4d63-9327-4bac162a2dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Volume 26e79963-0b09-4c06-a0e8-393737329111: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26e79963-0b09-4c06-a0e8-393737329111', 'volume_size': 1, 'snapshot_id': '9d8a83df-4733-4028-bd23-00b2a5dd9f16'} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Flow 'volume_create_manager' (8c9e3292-af5b-4c8e-bb8b-3eae9d92a018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d999ab2d-e053-419c-aa04-981300e4d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d999ab2d-e053-419c-aa04-981300e4d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863643323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe8b465-6b9c-41a6-8cb6-695097eebfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f5c999530949afa529ef761b7d6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:34:36Z,use_quota=True,user_id='75496985c9294d74b13fb3ad4a4ad8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb959648-0acc-4a41-899b-48c3b22d9cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb959648-0acc-4a41-899b-48c3b22d9cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ea0311-65a4-4950-b900-043476ff2122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ea0311-65a4-4950-b900-043476ff2122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe8b465-6b9c-41a6-8cb6-695097eebfa9', 'volume_name': 'volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48691063-3924-4139-8056-6c48f2c4715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48691063-3924-4139-8056-6c48f2c4715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef612064-847d-43a9-a978-84d18179f702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Volume 4fe8b465-6b9c-41a6-8cb6-695097eebfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9', 'volume_size': 1} Jul 05 18:34:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:36 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-b43d42de-096c-49c5-8d52-b70a60fcc85c req-702bf571-7fe2-464d-b2f5-ad343eaddb40 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9" returned: 0 in 0.946s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-b43d42de-096c-49c5-8d52-b70a60fcc85c req-702bf571-7fe2-464d-b2f5-ad343eaddb40 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.401s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Acquiring lock "cinder-quobyte-9d8a83df-4733-4028-bd23-00b2a5dd9f16-26e79963-0b09-4c06-a0e8-393737329111" by "_create_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-9d8a83df-4733-4028-bd23-00b2a5dd9f16-26e79963-0b09-4c06-a0e8-393737329111" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Creating volume 26e79963-0b09-4c06-a0e8-393737329111 from snapshot 9d8a83df-4733-4028-bd23-00b2a5dd9f16 {{(pid=86664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Acquiring lock "cinder-quobyte-26e79963-0b09-4c06-a0e8-393737329111" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-26e79963-0b09-4c06-a0e8-393737329111" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] snapshot: 9d8a83df-4733-4028-bd23-00b2a5dd9f16, volume: 26e79963-0b09-4c06-a0e8-393737329111, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-b43d42de-096c-49c5-8d52-b70a60fcc85c req-702bf571-7fe2-464d-b2f5-ad343eaddb40 tempest-TestInstancesWithCinderVolumes-97965628 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a15e290e-cdb6-4bf4-9f94-ec461105f99d', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1f237f-dc19-4efe-a238-5a179f56ab73]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:36 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-b43d42de-096c-49c5-8d52-b70a60fcc85c req-702bf571-7fe2-464d-b2f5-ad343eaddb40 tempest-TestInstancesWithCinderVolumes-97965628 None] attachment_update completed successfully. Jul 05 18:34:36 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 Jul 05 18:34:36 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:37 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16" returned: 0 in 0.821s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:34:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:34:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:34:37 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8bae72-833e-494e-a689-140c766ab36c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:37 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f Jul 05 18:34:37 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:38 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f" returned: 0 in 0.885s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:38 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:34:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:38 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 Jul 05 18:34:38 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:44 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111" returned: 0 in 5.974s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:44 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e5170c-f573-4a99-bf52-6e9c9346723a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:44 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f Jul 05 18:34:44 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:45 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f" returned: 0 in 1.146s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:45 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:34:45 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Converted 1024.00 MB image at 171.38 MB/s Jul 05 18:34:45 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 is being set with open permissions: ugo+rw Jul 05 18:34:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:45 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 Jul 05 18:34:45 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:46 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111" returned: 0 in 0.963s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-26e79963-0b09-4c06-a0e8-393737329111" released by "_copy_volume_from_snapshot" :: held 9.948s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-9d8a83df-4733-4028-bd23-00b2a5dd9f16-26e79963-0b09-4c06-a0e8-393737329111" released by "_create_volume_from_snapshot" :: held 9.997s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.020s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.375s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863643323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe8b465-6b9c-41a6-8cb6-695097eebfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f5c999530949afa529ef761b7d6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:34:36Z,use_quota=True,user_id='75496985c9294d74b13fb3ad4a4ad8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Creating volume 4fe8b465-6b9c-41a6-8cb6-695097eebfa9 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:34:46 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:46 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 1073741824 Jul 05 18:34:46 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034a42f9-52d4-4d63-9327-4bac162a2dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e79963-0b09-4c06-a0e8-393737329111', 'volume_size': 1, 'snapshot_id': '9d8a83df-4733-4028-bd23-00b2a5dd9f16'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0729aed-7c7f-46a1-8d89-496e14778199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:46 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Volume volume-26e79963-0b09-4c06-a0e8-393737329111 (26e79963-0b09-4c06-a0e8-393737329111): created successfully Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0729aed-7c7f-46a1-8d89-496e14778199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:46 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Flow 'volume_create_manager' (5b062592-ae85-49f9-868e-3a385045206c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:46 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-27169a07-c587-48e9-befb-ec008ba1f011 tempest-TestStampPattern-802381062 None] Created volume successfully. Jul 05 18:34:47 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 1073741824" returned: 0 in 1.018s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:47 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 Jul 05 18:34:47 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-8c53da54-4de3-49ff-b7b0-f430064825a1 req-99ffd2c5-485a-4759-9e14-3fb4833711dd tempest-TestInstancesWithCinderVolumes-97965628 None] Terminate volume connection completed successfully. Jul 05 18:34:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-8c53da54-4de3-49ff-b7b0-f430064825a1 req-99ffd2c5-485a-4759-9e14-3fb4833711dd tempest-TestInstancesWithCinderVolumes-97965628 None] Deleting attachment c30bd617-8082-40ae-ab65-64b4a835efd7. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:34:48 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9" returned: 0 in 0.736s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:34:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef612064-847d-43a9-a978-84d18179f702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150f4280-f610-427c-9fe2-22a88cf37a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:48 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Volume volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 (4fe8b465-6b9c-41a6-8cb6-695097eebfa9): created successfully Jul 05 18:34:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150f4280-f610-427c-9fe2-22a88cf37a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Flow 'volume_create_manager' (8c9e3292-af5b-4c8e-bb8b-3eae9d92a018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d943b539-2f57-46bd-b4d4-ba26bee6cf78 tempest-ProjectReaderTests-1091167357 None] Created volume successfully. Jul 05 18:34:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "cinder-4fe8b465-6b9c-41a6-8cb6-695097eebfa9-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-4fe8b465-6b9c-41a6-8cb6-695097eebfa9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "cinder-quobyte-4fe8b465-6b9c-41a6-8cb6-695097eebfa9" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-quobyte-4fe8b465-6b9c-41a6-8cb6-695097eebfa9" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc92837-9ba0-4690-87de-1e0331fe3bd1]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:49 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 Jul 05 18:34:49 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "cinder-db81850b-7e91-47a1-ac25-2b3e8808fc0a-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-db81850b-7e91-47a1-ac25-2b3e8808fc0a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:50 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9" returned: 0 in 1.060s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:50 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9 Jul 05 18:34:50 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "cinder-quobyte-db81850b-7e91-47a1-ac25-2b3e8808fc0a" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-quobyte-db81850b-7e91-47a1-ac25-2b3e8808fc0a" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c1e4b4-a25a-49b9-b842-4017ec24e043]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:50 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a Jul 05 18:34:50 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:50 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4fe8b465-6b9c-41a6-8cb6-695097eebfa9" returned: 0 in 0.810s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-quobyte-4fe8b465-6b9c-41a6-8cb6-695097eebfa9" released by "delete_volume" :: held 1.919s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:51 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Created reservations ['f4bfd207-236d-4e4b-9f96-9347b9ef5883', '2efe7d61-f793-4bd0-a45f-7fefea4a1084', 'e456cf99-0554-4c7d-aa97-7286732b7a21', 'b1bed2fb-cbe5-49b7-941b-b973e5bbfc1d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:34:51 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a" returned: 0 in 0.930s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:51 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a Jul 05 18:34:51 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:51 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:34:51 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Flow 'volume_create_manager' (c04e4a7a-40bb-4259-aad5-3785f5e9a725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d3c4f7-6192-4aaf-bfb0-3567bd77aa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d3c4f7-6192-4aaf-bfb0-3567bd77aa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754066542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00406e52-1c00-432a-a609-10e1e974cc0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f5c999530949afa529ef761b7d6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:34:52Z,use_quota=True,user_id='75496985c9294d74b13fb3ad4a4ad8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604b3f36-da7d-4457-9959-5cd4c834affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:52 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604b3f36-da7d-4457-9959-5cd4c834affb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745f105b-9e69-4603-8623-2187897b8e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745f105b-9e69-4603-8623-2187897b8e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00406e52-1c00-432a-a609-10e1e974cc0f', 'volume_name': 'volume-00406e52-1c00-432a-a609-10e1e974cc0f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2686e3-f510-45b6-9b6d-c4dc6e18d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2686e3-f510-45b6-9b6d-c4dc6e18d68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577e720c-9d2a-4c5b-8cca-1f1da00bb188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:52 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Volume 00406e52-1c00-432a-a609-10e1e974cc0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00406e52-1c00-432a-a609-10e1e974cc0f', 'volume_size': 1} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754066542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00406e52-1c00-432a-a609-10e1e974cc0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f5c999530949afa529ef761b7d6b56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:34:52Z,use_quota=True,user_id='75496985c9294d74b13fb3ad4a4ad8ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Creating volume 00406e52-1c00-432a-a609-10e1e974cc0f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:34:52 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:52 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-db81850b-7e91-47a1-ac25-2b3e8808fc0a" returned: 0 in 1.130s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.108s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:34:52 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f 1073741824 Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-quobyte-db81850b-7e91-47a1-ac25-2b3e8808fc0a" released by "delete_volume" :: held 2.128s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:52 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:52 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Deleted volume successfully. Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-088892e5-2050-4a96-8dea-a6dcf2819d39 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-4fe8b465-6b9c-41a6-8cb6-695097eebfa9-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:52 devstack cinder-volume[86664]: WARNING cinder.quota [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-358196355-1008805157 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-358196355-1008805157, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:34:52 devstack cinder-volume[86664]: WARNING cinder.quota [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-358196355-1008805157 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-358196355-1008805157, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Created reservations ['a9397978-9526-4868-b64f-8a7d7df82965', '4316626a-cc73-404d-bf61-340d79c1e8d9', '1edf56ec-5dff-4122-92d0-ce65d0f6359d', 'ea7cddef-3a07-4bfc-92a4-6fe78c28fcd6'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:52 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:34:52 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:53 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.000s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:53 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:34:53 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Deleted volume successfully. Jul 05 18:34:53 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f 1073741824" returned: 0 in 1.345s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b00c304b-6f12-43f0-86a3-b21b10dc8a97 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-db81850b-7e91-47a1-ac25-2b3e8808fc0a-delete_volume" released by "delete_volume" :: held 3.543s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:53 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f Jul 05 18:34:53 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:54 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f" returned: 0 in 1.205s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] <== create_volume: return (2622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:34:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.626s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (577e720c-9d2a-4c5b-8cca-1f1da00bb188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00406e52-1c00-432a-a609-10e1e974cc0f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf3eee8-7e27-4072-ac9d-e77268b46671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:34:54 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Volume volume-00406e52-1c00-432a-a609-10e1e974cc0f (00406e52-1c00-432a-a609-10e1e974cc0f): created successfully Jul 05 18:34:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf3eee8-7e27-4072-ac9d-e77268b46671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:34:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Flow 'volume_create_manager' (c04e4a7a-40bb-4259-aad5-3785f5e9a725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:34:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-de94610e-e9e6-4a11-a7e1-6ac62b895059 tempest-ProjectReaderTests-1091167357 None] Created volume successfully. Jul 05 18:34:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "cinder-00406e52-1c00-432a-a609-10e1e974cc0f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-00406e52-1c00-432a-a609-10e1e974cc0f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "cinder-quobyte-00406e52-1c00-432a-a609-10e1e974cc0f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-quobyte-00406e52-1c00-432a-a609-10e1e974cc0f" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:55 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1510f85e-d125-4755-b56c-fb0560c747c0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:55 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f Jul 05 18:34:55 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-27148243-b608-4242-abad-a18eaae2be0e req-ce8bbf62-5b88-4e43-9189-30a9b17203f7 tempest-TestInstancesWithCinderVolumes-97965628 None] Terminate volume connection completed successfully. Jul 05 18:34:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-27148243-b608-4242-abad-a18eaae2be0e req-ce8bbf62-5b88-4e43-9189-30a9b17203f7 tempest-TestInstancesWithCinderVolumes-97965628 None] Deleting attachment a15e290e-cdb6-4bf4-9f94-ec461105f99d. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:34:56 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f" returned: 0 in 1.018s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:56 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f Jul 05 18:34:56 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:57 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-00406e52-1c00-432a-a609-10e1e974cc0f" returned: 0 in 0.810s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-quobyte-00406e52-1c00-432a-a609-10e1e974cc0f" released by "delete_volume" :: held 1.898s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:57 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Created reservations ['10d33179-6541-43f5-916a-02cfb4fea4e9', '1452afbc-a6d1-45d6-a84f-37375f874059', 'd7bb3e6c-ed29-4be7-b3ad-85fe9fbc133d', 'f019f903-528c-4cc6-9e14-928f12744ef8'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:34:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:34:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:34:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:34:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:34:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:34:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:57 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:34:57 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "cinder-7ac9e526-7cb9-4cb1-b404-db1145789fe9-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-7ac9e526-7cb9-4cb1-b404-db1145789fe9-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "cinder-quobyte-7ac9e526-7cb9-4cb1-b404-db1145789fe9" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:34:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-quobyte-7ac9e526-7cb9-4cb1-b404-db1145789fe9" acquired by "delete_volume" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:34:58 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[860d2867-4bfc-4e3c-a524-a8545abe8d8c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:34:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:58 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 Jul 05 18:34:58 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:34:58 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.219s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:58 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:34:58 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Deleted volume successfully. Jul 05 18:34:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a33e71e2-69cf-4263-904a-b6f6fa32f4b1 tempest-ProjectReaderTests-1091167357 None] Lock "cinder-00406e52-1c00-432a-a609-10e1e974cc0f-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:34:59 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 05 18:34:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9" returned: 0 in 1.153s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:34:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:34:59 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9 Jul 05 18:34:59 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:00 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-7ac9e526-7cb9-4cb1-b404-db1145789fe9" returned: 0 in 1.019s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-quobyte-7ac9e526-7cb9-4cb1-b404-db1145789fe9" released by "delete_volume" :: held 2.272s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:00 devstack cinder-volume[86664]: WARNING cinder.quota [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115148065-1964884075 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115148065-1964884075, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:35:00 devstack cinder-volume[86664]: WARNING cinder.quota [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115148065-1964884075 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115148065-1964884075, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:35:00 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Created reservations ['77210637-c78a-4117-ad67-3b43b6415edc', 'd47e7fc1-f90c-45cd-946a-73a8fa372414', '67b5d5de-b65b-4140-bab1-e25376d333a7', '3bf5a20b-9760-47e1-8d24-f7df634f34a2'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:35:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:35:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:35:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:01 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:35:01 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:02 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.274s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:02 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:35:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Deleted volume successfully. Jul 05 18:35:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2255d8d8-22ce-4064-a902-d2821facc92e tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-7ac9e526-7cb9-4cb1-b404-db1145789fe9-delete_volume" released by "delete_volume" :: held 4.085s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-bc153621-8b3e-42b4-9119-3947fbed2bbf req-d726c91e-5b86-452a-97e4-da6e4ed9a10f tempest-TestInstancesWithCinderVolumes-97965628 None] Terminate volume connection completed successfully. Jul 05 18:35:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-bc153621-8b3e-42b4-9119-3947fbed2bbf req-d726c91e-5b86-452a-97e4-da6e4ed9a10f tempest-TestInstancesWithCinderVolumes-97965628 None] Deleting attachment 9e7f61a4-a9b7-4111-afeb-0308441fcd60. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:35:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "cinder-f280a1a7-dd78-4794-82dc-7e8dde7d944f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-f280a1a7-dd78-4794-82dc-7e8dde7d944f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "cinder-quobyte-f280a1a7-dd78-4794-82dc-7e8dde7d944f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-quobyte-f280a1a7-dd78-4794-82dc-7e8dde7d944f" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:10 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[501ccbeb-01a0-4110-a9e2-040f4efb61c1]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:11 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f Jul 05 18:35:11 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:11 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f" returned: 0 in 0.877s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:11 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f Jul 05 18:35:11 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:12 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:35:12 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:12 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f" returned: 1 in 0.940s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:12 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f Jul 05 18:35:12 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:12 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.749s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:35:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:35:13 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f280a1a7-dd78-4794-82dc-7e8dde7d944f" returned: 0 in 0.745s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-quobyte-f280a1a7-dd78-4794-82dc-7e8dde7d944f" released by "delete_volume" :: held 2.637s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:13 devstack cinder-volume[86664]: WARNING cinder.quota [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1329675860-1191478435 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1329675860-1191478435, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:35:13 devstack cinder-volume[86664]: WARNING cinder.quota [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1329675860-1191478435 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1329675860-1191478435, it is now deprecated. Please use the default quota class for default quota. Jul 05 18:35:13 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Created reservations ['843fafb4-a492-445c-afb7-c6f54c66630e', '8f383cf1-7098-4e31-916c-5dbe7df6b493', 'ee329fda-90ec-4f02-bcbb-5b079b0abe29', '429c3868-2dcf-4b3d-b7fd-161e6957187d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:35:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:35:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:35:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:13 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:35:13 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:14 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.731s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:14 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:35:14 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Deleted volume successfully. Jul 05 18:35:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0c8dc981-b237-498f-b94c-769a151cab47 tempest-TestInstancesWithCinderVolumes-97965628 None] Lock "cinder-f280a1a7-dd78-4794-82dc-7e8dde7d944f-delete_volume" released by "delete_volume" :: held 3.611s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:17 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=66,cinder:INSERT=14,cinder:UPDATE=84,cinder:DELETE=8 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:35:17 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:INSERT=23,cinder:UPDATE=81,cinder:SELECT=69,cinder:DELETE=6 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Flow 'volume_create_manager' (a7219713-bb62-4208-b046-073b9c964177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45e0cff-cf94-493b-a457-fad7c3267272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45e0cff-cf94-493b-a457-fad7c3267272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2069551945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb75813-c52e-4cb7-8d7e-01fbc2468d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764b16b7f0994db19de0fd231362ac61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:35:29Z,use_quota=True,user_id='03bd5672e969426b8e52100f94b7e957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f8639c-c38a-4444-b48d-69e8cff8110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f8639c-c38a-4444-b48d-69e8cff8110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08445717-6403-4887-9b26-b8b0af8668f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08445717-6403-4887-9b26-b8b0af8668f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb75813-c52e-4cb7-8d7e-01fbc2468d2b', 'volume_name': 'volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96e947e-2777-4c5a-9009-bd1c08491743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96e947e-2777-4c5a-9009-bd1c08491743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa11c73-a845-4ce1-901b-5c32a46a500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:29 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Volume 8eb75813-c52e-4cb7-8d7e-01fbc2468d2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b', 'volume_size': 1} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2069551945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb75813-c52e-4cb7-8d7e-01fbc2468d2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764b16b7f0994db19de0fd231362ac61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:35:29Z,use_quota=True,user_id='03bd5672e969426b8e52100f94b7e957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Creating volume 8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:35:29 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:35:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:29 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b 1073741824 Jul 05 18:35:29 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:30 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b 1073741824" returned: 0 in 1.042s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:30 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b Jul 05 18:35:30 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:31 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" returned: 0 in 0.778s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:35:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa11c73-a845-4ce1-901b-5c32a46a500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4acefd4-dc06-445d-8f2d-f22a020675aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:31 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Volume volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b (8eb75813-c52e-4cb7-8d7e-01fbc2468d2b): created successfully Jul 05 18:35:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4acefd4-dc06-445d-8f2d-f22a020675aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Flow 'volume_create_manager' (a7219713-bb62-4208-b046-073b9c964177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:35:31 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9682c2ce-4c39-4cde-a36b-8b0d22560e75 tempest-SnapshotDependencyTests-362785880 None] Created volume successfully. Jul 05 18:35:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Creating offline snapshot 75f0c778-6211-4120-aed6-6a9361eccf8a of volume 8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:35:32 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b7043e-0890-4246-acc8-8bf3da948192]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:32 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b Jul 05 18:35:32 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:33 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" returned: 0 in 1.197s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:33 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a 1G Jul 05 18:35:33 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:34 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a 1G" returned: 0 in 0.944s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:34 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a Jul 05 18:35:34 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:35 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a" returned: 0 in 0.773s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:35 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a is being set with open permissions: ugo+rw Jul 05 18:35:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:35 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a Jul 05 18:35:35 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:36 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a" returned: 0 in 0.882s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:36 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.info Jul 05 18:35:36 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-a09270d3-c23d-4ed8-b125-0221170e62d4 req-1df54954-de8a-46e2-aedb-607d5017f224 tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:37 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.info" returned: 0 in 0.825s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:37 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.info is being set with open permissions: ugo+rw Jul 05 18:35:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:37 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.info Jul 05 18:35:37 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:38 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.info" returned: 0 in 0.897s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.655s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-a09270d3-c23d-4ed8-b125-0221170e62d4 req-1df54954-de8a-46e2-aedb-607d5017f224 tempest-TestStampPattern-802381062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.220s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c635aa2c-5fbb-4554-8908-3641db2830ab]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-a09270d3-c23d-4ed8-b125-0221170e62d4 req-1df54954-de8a-46e2-aedb-607d5017f224 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:38 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0eb3a050-b44b-4164-b1e6-3e432850c432 tempest-SnapshotDependencyTests-362785880 None] Create snapshot completed successfully Jul 05 18:35:38 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 Jul 05 18:35:38 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:39 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-a09270d3-c23d-4ed8-b125-0221170e62d4 req-1df54954-de8a-46e2-aedb-607d5017f224 tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111" returned: 0 in 1.014s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-a09270d3-c23d-4ed8-b125-0221170e62d4 req-1df54954-de8a-46e2-aedb-607d5017f224 tempest-TestStampPattern-802381062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-a09270d3-c23d-4ed8-b125-0221170e62d4 req-1df54954-de8a-46e2-aedb-607d5017f224 tempest-TestStampPattern-802381062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-26e79963-0b09-4c06-a0e8-393737329111', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fe379ee-ce87-432c-9f3e-59b48310bd40', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:35:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-a09270d3-c23d-4ed8-b125-0221170e62d4 req-1df54954-de8a-46e2-aedb-607d5017f224 tempest-TestStampPattern-802381062 None] attachment_update completed successfully. Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Flow 'volume_create_manager' (1b0f7794-2db4-4b40-b83e-7c593da53705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0944af84-d586-4d01-aa01-b764726a4353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0944af84-d586-4d01-aa01-b764726a4353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6d1e4f-11bd-4cde-a183-a396aca78e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764b16b7f0994db19de0fd231362ac61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75f0c778-6211-4120-aed6-6a9361eccf8a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:35:40Z,use_quota=True,user_id='03bd5672e969426b8e52100f94b7e957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c46a792-6ecf-44a3-bb45-ea425a3a49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c46a792-6ecf-44a3-bb45-ea425a3a49b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5771c891-81ea-4d14-98eb-975c6ce931dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5771c891-81ea-4d14-98eb-975c6ce931dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f6d1e4f-11bd-4cde-a183-a396aca78e20', 'volume_name': 'volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20', 'volume_size': 1, 'snapshot_id': '75f0c778-6211-4120-aed6-6a9361eccf8a'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3af47f-565d-4ab4-8b25-5359789505b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3af47f-565d-4ab4-8b25-5359789505b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e7c11c-f29d-4842-84e0-e1ba85ae9c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:40 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Volume 2f6d1e4f-11bd-4cde-a183-a396aca78e20: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20', 'volume_size': 1, 'snapshot_id': '75f0c778-6211-4120-aed6-6a9361eccf8a'} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "cinder-quobyte-75f0c778-6211-4120-aed6-6a9361eccf8a-2f6d1e4f-11bd-4cde-a183-a396aca78e20" by "_create_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-75f0c778-6211-4120-aed6-6a9361eccf8a-2f6d1e4f-11bd-4cde-a183-a396aca78e20" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Creating volume 2f6d1e4f-11bd-4cde-a183-a396aca78e20 from snapshot 75f0c778-6211-4120-aed6-6a9361eccf8a {{(pid=86664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "cinder-quobyte-2f6d1e4f-11bd-4cde-a183-a396aca78e20" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-2f6d1e4f-11bd-4cde-a183-a396aca78e20" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] snapshot: 75f0c778-6211-4120-aed6-6a9361eccf8a, volume: 2f6d1e4f-11bd-4cde-a183-a396aca78e20, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c4f9af-6c5d-4e47-aa74-07897a05291b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:40 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a Jul 05 18:35:40 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:41 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a" returned: 0 in 1.020s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:35:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:35:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:35:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[221d0758-1c7d-4036-950f-f777e476c764]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:41 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b Jul 05 18:35:41 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:42 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" returned: 0 in 1.065s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:42 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:35:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:42 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 Jul 05 18:35:42 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-8b82204b-0a0e-4e86-b572-453fb3823a7d req-0e5b8364-902f-4d90-b239-83ca7b09ae09 tempest-TestStampPattern-802381062 None] Terminate volume connection completed successfully. Jul 05 18:35:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-8b82204b-0a0e-4e86-b572-453fb3823a7d req-0e5b8364-902f-4d90-b239-83ca7b09ae09 tempest-TestStampPattern-802381062 None] Deleting attachment 2fe379ee-ce87-432c-9f3e-59b48310bd40. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:35:49 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20" returned: 0 in 6.711s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[debe74fe-54d6-4d71-9215-652a523d46a8]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:49 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b Jul 05 18:35:49 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:50 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:35:50 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" returned: 0 in 1.153s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:50 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:35:50 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Converted 1024.00 MB image at 152.56 MB/s Jul 05 18:35:50 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 is being set with open permissions: ugo+rw Jul 05 18:35:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:50 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 Jul 05 18:35:50 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:51 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20" returned: 0 in 1.076s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-2f6d1e4f-11bd-4cde-a183-a396aca78e20" released by "_copy_volume_from_snapshot" :: held 11.164s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-75f0c778-6211-4120-aed6-6a9361eccf8a-2f6d1e4f-11bd-4cde-a183-a396aca78e20" released by "_create_volume_from_snapshot" :: held 11.217s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.254s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e7c11c-f29d-4842-84e0-e1ba85ae9c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20', 'volume_size': 1, 'snapshot_id': '75f0c778-6211-4120-aed6-6a9361eccf8a'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85108924-b2c2-4d1e-be0f-f029791efe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:35:51 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Volume volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 (2f6d1e4f-11bd-4cde-a183-a396aca78e20): created successfully Jul 05 18:35:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85108924-b2c2-4d1e-be0f-f029791efe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:35:51 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Flow 'volume_create_manager' (1b0f7794-2db4-4b40-b83e-7c593da53705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:35:51 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4e2b9aae-56b7-4fad-993b-0aa85e8bb9c7 tempest-SnapshotDependencyTests-362785880 None] Created volume successfully. Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "cinder-75f0c778-6211-4120-aed6-6a9361eccf8a-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-75f0c778-6211-4120-aed6-6a9361eccf8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "cinder-quobyte-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "cinder-quobyte-75f0c778-6211-4120-aed6-6a9361eccf8a" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-75f0c778-6211-4120-aed6-6a9361eccf8a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Deleting offline snapshot 75f0c778-6211-4120-aed6-6a9361eccf8a of volume 8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] snapshot_file for this snap is: volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f793b79-b8cc-47fb-ba1b-f9e5f9c968a1]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:52 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a Jul 05 18:35:52 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:53 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a" returned: 0 in 0.912s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:35:53 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61e7e18-a523-4ebb-929c-5be1df5d874e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:53 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b Jul 05 18:35:53 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:54 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" returned: 0 in 0.940s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:54 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a Jul 05 18:35:54 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:55 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a" returned: 0 in 1.024s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:55 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a Jul 05 18:35:55 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:56 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b.75f0c778-6211-4120-aed6-6a9361eccf8a" returned: 0 in 0.945s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-75f0c778-6211-4120-aed6-6a9361eccf8a" released by "_delete_snapshot" :: held 3.954s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" released by "delete_snapshot" :: held 3.982s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:56 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Created reservations ['9b8c3b03-5ad5-466f-8e25-8f771ee64acf', 'fab75276-15d2-46a5-8553-b3b50851f8c6', '21f09013-aed6-4444-aa67-8fa667f320e0', 'd0c2ea24-3c55-4f3a-906d-c56b24444273'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:35:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Delete snapshot completed successfully. Jul 05 18:35:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-114387d2-da6d-4b50-acb9-62c7bf7a10ac tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-75f0c778-6211-4120-aed6-6a9361eccf8a-delete_snapshot" released by "delete_snapshot" :: held 4.312s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "cinder-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "cinder-quobyte-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df6bd4-a67e-41e6-af8f-8dbaac97f1d3]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:57 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b Jul 05 18:35:57 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:58 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" returned: 0 in 0.932s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:58 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b Jul 05 18:35:58 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Acquiring lock "cinder-26e79963-0b09-4c06-a0e8-393737329111-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:59 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" returned: 0 in 0.924s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b" released by "delete_volume" :: held 1.935s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Lock "cinder-26e79963-0b09-4c06-a0e8-393737329111-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Acquiring lock "cinder-quobyte-26e79963-0b09-4c06-a0e8-393737329111" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-26e79963-0b09-4c06-a0e8-393737329111" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Created reservations ['8c932636-642f-4aed-9c92-9030ecccf053', '98cfbb08-7fe7-4b9d-bb66-420ea9b74a31', 'd6ddb85b-50ba-4f2d-a5a7-f99cc0e44aa8', 'd8b9832f-33e4-40d0-8335-acee5ccdb61f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db6a898-b30f-4fb4-a955-25ff5f427cdd]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:59 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 Jul 05 18:35:59 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:59 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:35:59 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "cinder-2f6d1e4f-11bd-4cde-a183-a396aca78e20-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-2f6d1e4f-11bd-4cde-a183-a396aca78e20-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "cinder-quobyte-2f6d1e4f-11bd-4cde-a183-a396aca78e20" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-2f6d1e4f-11bd-4cde-a183-a396aca78e20" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9bb8d7-3588-44ab-8d99-ad2c170216f0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:35:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:35:59 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 Jul 05 18:35:59 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:00 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.816s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:00 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:36:00 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Deleted volume successfully. Jul 05 18:36:00 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111" returned: 0 in 1.003s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e729338d-eae2-4b7e-9b49-7dbbf9197bab tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-8eb75813-c52e-4cb7-8d7e-01fbc2468d2b-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:00 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111 Jul 05 18:36:00 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:00 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20" returned: 0 in 1.055s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:00 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20 Jul 05 18:36:00 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:00 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-26e79963-0b09-4c06-a0e8-393737329111" returned: 0 in 0.718s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-26e79963-0b09-4c06-a0e8-393737329111" released by "delete_volume" :: held 1.796s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Created reservations ['acf5b708-edf4-470d-920e-265388dc9d64', '4558b1ab-0d70-46ad-8365-97d3a959d017', 'a3208628-69b7-4fd0-942c-255ef09b49d7', '51b5e474-8ce3-4c25-ab70-3c90992e4b21'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:01 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:36:01 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:01 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2f6d1e4f-11bd-4cde-a183-a396aca78e20" returned: 0 in 0.841s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-quobyte-2f6d1e4f-11bd-4cde-a183-a396aca78e20" released by "delete_volume" :: held 1.975s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Created reservations ['5d771476-ba45-44fb-a007-7010c2ac8b4d', 'faeb35dd-3a83-4a7f-a647-81e2fa1de285', '88e07e49-7868-4c5f-8ee2-5af50f77d16c', '15d48b19-e8e3-4534-b99d-84e28743d0bc'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:01 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:36:01 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Acquiring lock "cinder-9d8a83df-4733-4028-bd23-00b2a5dd9f16-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Lock "cinder-9d8a83df-4733-4028-bd23-00b2a5dd9f16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:36:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Acquiring lock "cinder-quobyte-6e46a7d9-b853-49f6-a369-6edbdcdc057f" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-6e46a7d9-b853-49f6-a369-6edbdcdc057f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Acquiring lock "cinder-quobyte-9d8a83df-4733-4028-bd23-00b2a5dd9f16" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-9d8a83df-4733-4028-bd23-00b2a5dd9f16" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Deleting offline snapshot 9d8a83df-4733-4028-bd23-00b2a5dd9f16 of volume 6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] snapshot_file for this snap is: volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b64f47-fda6-41b6-b4ff-de5208a5c1d6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:02 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.083s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:36:02 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 Jul 05 18:36:02 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Deleted volume successfully. Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-df9ff742-fc66-4ac6-9fc2-bf936d95185b tempest-TestStampPattern-802381062 None] Lock "cinder-26e79963-0b09-4c06-a0e8-393737329111-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:02 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.905s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:36:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Deleted volume successfully. Jul 05 18:36:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ab65d3b6-eed4-45d3-abae-427207662dc6 tempest-SnapshotDependencyTests-362785880 None] Lock "cinder-2f6d1e4f-11bd-4cde-a183-a396aca78e20-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:03 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16" returned: 0 in 1.108s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:36:03 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[53339b79-db9e-47d0-b4fd-ee215d669289]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:03 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f Jul 05 18:36:03 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:04 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f" returned: 0 in 1.084s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:04 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 Jul 05 18:36:04 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:05 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16" returned: 0 in 1.006s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:05 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16 Jul 05 18:36:05 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:06 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f.9d8a83df-4733-4028-bd23-00b2a5dd9f16" returned: 0 in 0.756s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-9d8a83df-4733-4028-bd23-00b2a5dd9f16" released by "_delete_snapshot" :: held 4.145s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-6e46a7d9-b853-49f6-a369-6edbdcdc057f" released by "delete_snapshot" :: held 4.177s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:06 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Created reservations ['89a5b7c8-13c2-4e1d-bb95-c4fa61ad325d', 'a90905b2-b63c-4139-a7fb-10c364bb7091', '37a357b4-ec6b-4385-9943-ede2cb64d3f1', 'b1b26f85-5ca8-42aa-a1b0-264bdb052abb'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:36:06 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Delete snapshot completed successfully. Jul 05 18:36:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b21a0445-6cc8-407c-9fc6-24cab90ec5ef tempest-TestStampPattern-802381062 None] Lock "cinder-9d8a83df-4733-4028-bd23-00b2a5dd9f16-delete_snapshot" released by "delete_snapshot" :: held 4.400s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:36:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:36:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:36:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:12 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:36:12 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:13 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.131s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:13 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:36:13 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:36:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:36:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:36:16 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=39,cinder:UPDATE=41,cinder:DELETE=5,cinder:INSERT=14 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:36:16 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=39,cinder:SELECT=29,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:36:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Acquiring lock "cinder-6e46a7d9-b853-49f6-a369-6edbdcdc057f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:36:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Lock "cinder-6e46a7d9-b853-49f6-a369-6edbdcdc057f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:36:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Acquiring lock "cinder-quobyte-6e46a7d9-b853-49f6-a369-6edbdcdc057f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:36:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-6e46a7d9-b853-49f6-a369-6edbdcdc057f" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:36:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc6d53-5650-4cf0-bc09-a753c3f9735f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:17 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f Jul 05 18:36:17 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:18 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f" returned: 0 in 0.800s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:18 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f Jul 05 18:36:18 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:19 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6e46a7d9-b853-49f6-a369-6edbdcdc057f" returned: 0 in 0.890s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Lock "cinder-quobyte-6e46a7d9-b853-49f6-a369-6edbdcdc057f" released by "delete_volume" :: held 1.771s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:19 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Created reservations ['9f9a99f3-29cf-4b91-b8ca-093133bf5cc0', '624ff174-cad3-4b99-b0ab-840802a79a98', '4fb9c4e1-ec1b-47f6-8bf6-15258d059da9', 'b8205618-1c26-48e0-8894-010c46fda81f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:36:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:36:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:36:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:19 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:36:19 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:20 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.099s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:20 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:36:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Deleted volume successfully. Jul 05 18:36:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e4166601-11a4-4e35-b75b-c9972693ad26 tempest-TestStampPattern-802381062 None] Lock "cinder-6e46a7d9-b853-49f6-a369-6edbdcdc057f-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Flow 'volume_create_manager' (3e9996e9-dd9c-49c7-9b2a-9cb1a0465919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df3172e-65d6-43ff-ba77-904b0d1a6e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df3172e-65d6-43ff-ba77-904b0d1a6e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1663886379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12206a2f-97ad-40fc-870c-0e11c7beca83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeae4aa5a5d4bac99e2857b230c9e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:36:22Z,use_quota=True,user_id='dc9e1474915d4c48913b0a06e9459722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e6a05d-950c-4db6-a184-e26e712277de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e6a05d-950c-4db6-a184-e26e712277de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efffe3d7-c7f3-4b85-b09d-f18d24ce9375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efffe3d7-c7f3-4b85-b09d-f18d24ce9375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12206a2f-97ad-40fc-870c-0e11c7beca83', 'volume_name': 'volume-12206a2f-97ad-40fc-870c-0e11c7beca83', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125d7490-a3de-4347-ba9a-4875012a4c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125d7490-a3de-4347-ba9a-4875012a4c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a38e2f-b81a-4034-b4eb-c9e29f931521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:21 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Volume 12206a2f-97ad-40fc-870c-0e11c7beca83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12206a2f-97ad-40fc-870c-0e11c7beca83', 'volume_size': 1} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1663886379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12206a2f-97ad-40fc-870c-0e11c7beca83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeae4aa5a5d4bac99e2857b230c9e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:36:22Z,use_quota=True,user_id='dc9e1474915d4c48913b0a06e9459722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Creating volume 12206a2f-97ad-40fc-870c-0e11c7beca83 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:36:21 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:36:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:22 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 1073741824 Jul 05 18:36:22 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:23 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 1073741824" returned: 0 in 1.070s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:23 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 Jul 05 18:36:23 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:23 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83" returned: 0 in 0.778s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:36:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a38e2f-b81a-4034-b4eb-c9e29f931521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12206a2f-97ad-40fc-870c-0e11c7beca83', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6565beab-d4b5-47f3-ba3e-9a92bea2db4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:23 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Volume volume-12206a2f-97ad-40fc-870c-0e11c7beca83 (12206a2f-97ad-40fc-870c-0e11c7beca83): created successfully Jul 05 18:36:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6565beab-d4b5-47f3-ba3e-9a92bea2db4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:23 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Flow 'volume_create_manager' (3e9996e9-dd9c-49c7-9b2a-9cb1a0465919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:36:23 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9ad06623-8b8a-4126-9473-b0e3bfeb9d52 tempest-TestMinimumBasicScenario-830088079 None] Created volume successfully. Jul 05 18:36:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-8d9410c1-6989-404d-a93a-4cadc752fc0d req-605a64e5-3239-4322-b36b-fc53389722ab tempest-TestMinimumBasicScenario-830088079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-8d9410c1-6989-404d-a93a-4cadc752fc0d req-605a64e5-3239-4322-b36b-fc53389722ab tempest-TestMinimumBasicScenario-830088079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:28 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fc1318-2e4d-4ac5-918e-7c41769670f8]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-8d9410c1-6989-404d-a93a-4cadc752fc0d req-605a64e5-3239-4322-b36b-fc53389722ab tempest-TestMinimumBasicScenario-830088079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:28 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 Jul 05 18:36:28 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:29 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-8d9410c1-6989-404d-a93a-4cadc752fc0d req-605a64e5-3239-4322-b36b-fc53389722ab tempest-TestMinimumBasicScenario-830088079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83" returned: 0 in 0.923s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-8d9410c1-6989-404d-a93a-4cadc752fc0d req-605a64e5-3239-4322-b36b-fc53389722ab tempest-TestMinimumBasicScenario-830088079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.992s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-8d9410c1-6989-404d-a93a-4cadc752fc0d req-605a64e5-3239-4322-b36b-fc53389722ab tempest-TestMinimumBasicScenario-830088079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-12206a2f-97ad-40fc-870c-0e11c7beca83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ee652ee-713d-4aca-80ef-eb8fc0d407e9', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:36:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-8d9410c1-6989-404d-a93a-4cadc752fc0d req-605a64e5-3239-4322-b36b-fc53389722ab tempest-TestMinimumBasicScenario-830088079 None] attachment_update completed successfully. Jul 05 18:36:35 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Flow 'volume_create_manager' (7aa76493-6f07-4fc7-bfd9-8d65b74fad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad286f73-e1d5-4110-9149-d1827eb6a8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad286f73-e1d5-4110-9149-d1827eb6a8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cde538d-3007-474c-a498-b83cd05c820d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d50c20755940239d2454eb7d86d906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:36:36Z,use_quota=True,user_id='5f1d0f7fddd447da93fa16cefb01f138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90968e5-a5f1-4a8c-ba9a-68552cf70a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b90968e5-a5f1-4a8c-ba9a-68552cf70a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d3cf6c-d0a1-471d-952f-3872365e39b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.image.glance [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Creating Keystone auth plugin from conf {{(pid=86664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d3cf6c-d0a1-471d-952f-3872365e39b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8cde538d-3007-474c-a498-b83cd05c820d', 'volume_name': 'volume-8cde538d-3007-474c-a498-b83cd05c820d', 'volume_size': 1, 'image_id': 'e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b45a05fb1355834b0c4055bd3a50962', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79d50c20755940239d2454eb7d86d906', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f757ee333a39655c10341c1416136d5084c7dcfebd7fb762ac1e3302a81f48c943ee6f30ae9a088042910f06555a95c52dead86d1cd5a0bd079894ec53a4cdbc', 'id': 'e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'created_at': datetime.datetime(2026, 7, 5, 16, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f/file', 'properties': {}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b49c200-e285-4159-83b4-ad03010f97eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b49c200-e285-4159-83b4-ad03010f97eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e63efa4-9a1b-4b89-bd75-3a521c8f4427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:36 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Volume 8cde538d-3007-474c-a498-b83cd05c820d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8cde538d-3007-474c-a498-b83cd05c820d', 'volume_size': 1, 'image_id': 'e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b45a05fb1355834b0c4055bd3a50962', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79d50c20755940239d2454eb7d86d906', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f757ee333a39655c10341c1416136d5084c7dcfebd7fb762ac1e3302a81f48c943ee6f30ae9a088042910f06555a95c52dead86d1cd5a0bd079894ec53a4cdbc', 'id': 'e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'created_at': datetime.datetime(2026, 7, 5, 16, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f/file', 'properties': {}}, 'image_service': } Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Trying to clone 8cde538d-3007-474c-a498-b83cd05c820d from image e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'metadata': {}}]). {{(pid=86664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 18:36:36 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Image download 0.00 MB at 0.00 MB/s Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993f741-c435-442a-b1a8-6d159ae7a67b]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:36 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD Jul 05 18:36:36 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:37 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD" returned: 0 in 0.777s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:37 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD Jul 05 18:36:37 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:38 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD" returned: 1 in 0.961s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:36:38 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Temporary image e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f is fetched for user 5f1d0f7fddd447da93fa16cefb01f138. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 18:36:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13faea4-05cb-4103-8354-b8691d600fbc]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:38 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD Jul 05 18:36:38 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:39 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD" returned: 0 in 0.996s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:39 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD Jul 05 18:36:39 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:40 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD" returned: 1 in 0.815s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cde538d-3007-474c-a498-b83cd05c820d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d50c20755940239d2454eb7d86d906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:36:36Z,use_quota=True,user_id='5f1d0f7fddd447da93fa16cefb01f138',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Creating volume 8cde538d-3007-474c-a498-b83cd05c820d {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:36:40 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:36:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:40 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d 1073741824 Jul 05 18:36:40 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:41 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d 1073741824" returned: 0 in 0.934s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:41 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d Jul 05 18:36:41 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:41 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d" returned: 0 in 0.759s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:36:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:41 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Attempting download of e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f ((None, [{'url': 'file:///opt/stack/data/glance/images/e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'metadata': {}}])) to volume 8cde538d-3007-474c-a498-b83cd05c820d. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 18:36:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c084c196-e695-4cd8-a3c7-ca6808a80065]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_pugb1ud3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:42 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_pugb1ud3 Jul 05 18:36:42 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:42 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_pugb1ud3" returned: 0 in 0.757s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_pugb1ud3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:42 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_pugb1ud3 Jul 05 18:36:42 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:43 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_pugb1ud3" returned: 1 in 0.899s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_pugb1ud3' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:36:43 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be51371-c27d-492b-bf9a-a59b5f60d88f]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:43 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD Jul 05 18:36:43 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:44 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD" returned: 0 in 0.875s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:44 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD Jul 05 18:36:44 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:45 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD" returned: 1 in 0.792s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:36:45 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f was raw, converting to raw {{(pid=86664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 18:36:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:45 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d Jul 05 18:36:45 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:46 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d" returned: 0 in 0.790s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:46 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f_vgujctw_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:36:46 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 18:36:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:46 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d 1G Jul 05 18:36:46 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:46 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d 1G" returned: 0 in 0.718s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:46 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8689bf1e-7dbc-4876-918b-a74a9b1743fc]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:46 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d Jul 05 18:36:46 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:47 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d" returned: 0 in 0.824s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:47 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d Jul 05 18:36:47 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:48 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d" returned: 1 in 0.862s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Downloaded image e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f ((None, [{'url': 'file:///opt/stack/data/glance/images/e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'metadata': {}}])) to volume 8cde538d-3007-474c-a498-b83cd05c820d successfully. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Temporary image e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f for user 5f1d0f7fddd447da93fa16cefb01f138 is deleted. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Marking volume 8cde538d-3007-474c-a498-b83cd05c820d as bootable. {{(pid=86664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Copying metadata from image e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f to 8cde538d-3007-474c-a498-b83cd05c820d. {{(pid=86664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Creating volume glance metadata for volume 8cde538d-3007-474c-a498-b83cd05c820d backed by image e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f with: {'image_id': 'e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5b45a05fb1355834b0c4055bd3a50962', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e63efa4-9a1b-4b89-bd75-3a521c8f4427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cde538d-3007-474c-a498-b83cd05c820d', 'volume_size': 1, 'image_id': 'e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b45a05fb1355834b0c4055bd3a50962', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79d50c20755940239d2454eb7d86d906', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f757ee333a39655c10341c1416136d5084c7dcfebd7fb762ac1e3302a81f48c943ee6f30ae9a088042910f06555a95c52dead86d1cd5a0bd079894ec53a4cdbc', 'id': 'e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f', 'created_at': datetime.datetime(2026, 7, 5, 16, 36, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 36, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e58c4f47-3283-4cc2-9d91-efe2a0fbfb2f/file', 'properties': {}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bc7711-6d18-4562-a081-58d835627284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:36:48 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Volume volume-8cde538d-3007-474c-a498-b83cd05c820d (8cde538d-3007-474c-a498-b83cd05c820d): created successfully Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bc7711-6d18-4562-a081-58d835627284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Flow 'volume_create_manager' (7aa76493-6f07-4fc7-bfd9-8d65b74fad8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:36:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-825cb029-d52e-4181-8aba-41d59ae13a99 tempest-VolumeImageDependencyTests-1972635173 None] Created volume successfully. Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Acquiring lock "cinder-8cde538d-3007-474c-a498-b83cd05c820d-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Lock "cinder-8cde538d-3007-474c-a498-b83cd05c820d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Acquiring lock "cinder-quobyte-8cde538d-3007-474c-a498-b83cd05c820d" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:36:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Lock "cinder-quobyte-8cde538d-3007-474c-a498-b83cd05c820d" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:36:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec58d5b-1719-426e-9ced-787ab8aac16d]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:36:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:49 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d Jul 05 18:36:49 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:49 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d" returned: 0 in 0.791s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:49 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d Jul 05 18:36:49 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:50 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d" returned: 1 in 0.833s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:36:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:50 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d Jul 05 18:36:50 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:51 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-8cde538d-3007-474c-a498-b83cd05c820d" returned: 0 in 0.686s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Lock "cinder-quobyte-8cde538d-3007-474c-a498-b83cd05c820d" released by "delete_volume" :: held 2.390s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:36:51 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Created reservations ['2c5e8705-58b9-4bf9-a1a7-eee9cd45bc1c', '07805d2c-06f9-4cd9-ac61-a4455fa032a5', 'f22929d4-235a-4a33-8b83-590df52846be', '34f244fb-0e12-4174-b9f6-1dd610c82054'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:36:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:36:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:36:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:36:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:36:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:36:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:36:51 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:36:51 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:36:52 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Jul 05 18:36:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.727s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:36:52 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:36:52 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Deleted volume successfully. Jul 05 18:36:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-23f8dddb-5831-4a1d-87ea-3591c4799fa9 tempest-VolumeImageDependencyTests-1972635173 None] Lock "cinder-8cde538d-3007-474c-a498-b83cd05c820d-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:37:01 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=22 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:37:02 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=28,cinder:SELECT=24,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:37:12 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:37:12 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:37:12 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.719s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:37:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:37:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-f7214ba1-fb30-4f47-887c-9acc5c12dcef req-9aa4bf9c-094a-46e7-86f7-194302776a66 tempest-TestMinimumBasicScenario-830088079 None] Terminate volume connection completed successfully. Jul 05 18:37:20 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-f7214ba1-fb30-4f47-887c-9acc5c12dcef req-9aa4bf9c-094a-46e7-86f7-194302776a66 tempest-TestMinimumBasicScenario-830088079 None] Deleting attachment 0ee652ee-713d-4aca-80ef-eb8fc0d407e9. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:37:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Acquiring lock "cinder-12206a2f-97ad-40fc-870c-0e11c7beca83-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:37:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Lock "cinder-12206a2f-97ad-40fc-870c-0e11c7beca83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:37:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Acquiring lock "cinder-quobyte-12206a2f-97ad-40fc-870c-0e11c7beca83" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:37:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Lock "cinder-quobyte-12206a2f-97ad-40fc-870c-0e11c7beca83" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:37:22 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd7602a-b93d-4ac7-8daf-1dcb3f083180]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:37:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:37:22 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 Jul 05 18:37:22 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:37:23 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jul 05 18:37:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83" returned: 0 in 0.795s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:37:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:37:23 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83 Jul 05 18:37:23 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:37:24 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 05 18:37:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-12206a2f-97ad-40fc-870c-0e11c7beca83" returned: 0 in 0.641s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:37:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Lock "cinder-quobyte-12206a2f-97ad-40fc-870c-0e11c7beca83" released by "delete_volume" :: held 1.481s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:37:24 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Created reservations ['a718606a-0294-4539-9a81-27edf0277fe5', '8f916c95-3612-4d07-85ba-1cacf68ab6e7', '390fcc29-5efe-4c48-aeed-907baebd1307', 'ebeb8c0d-b801-4bc5-90b8-52c499d08761'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:37:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:37:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:37:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:37:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:37:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:37:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:37:24 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:37:24 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:37:25 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 05 18:37:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.667s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:37:25 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:37:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Deleted volume successfully. Jul 05 18:37:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8ced67b3-e7a9-457a-b3d6-3c844fe350f6 tempest-TestMinimumBasicScenario-830088079 None] Lock "cinder-12206a2f-97ad-40fc-870c-0e11c7beca83-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:37:34 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:37:35 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Flow 'volume_create_manager' (9e617d99-2772-4768-970c-d794689c7c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7f103d-8c41-4008-bd8d-22831ae90680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7f103d-8c41-4008-bd8d-22831ae90680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-348595963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6833d7a5-78bc-4913-be29-0e66e5d04d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b210718a0b43838f7bd003f8c5914b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:38:04Z,use_quota=True,user_id='692d07c6af9b4fa7a51d60ad7947d762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d98287e-b9b3-4485-b23f-4d226bc8e669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d98287e-b9b3-4485-b23f-4d226bc8e669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c964e23-1ea2-4211-87f4-c1754519f0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c964e23-1ea2-4211-87f4-c1754519f0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6833d7a5-78bc-4913-be29-0e66e5d04d00', 'volume_name': 'volume-6833d7a5-78bc-4913-be29-0e66e5d04d00', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a00fcbe-b09e-43eb-89ab-42c4bd071604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a00fcbe-b09e-43eb-89ab-42c4bd071604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77edbf5-ac49-4415-9d12-04bb7b804c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:03 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Volume 6833d7a5-78bc-4913-be29-0e66e5d04d00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6833d7a5-78bc-4913-be29-0e66e5d04d00', 'volume_size': 1} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-348595963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6833d7a5-78bc-4913-be29-0e66e5d04d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b210718a0b43838f7bd003f8c5914b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:38:04Z,use_quota=True,user_id='692d07c6af9b4fa7a51d60ad7947d762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Creating volume 6833d7a5-78bc-4913-be29-0e66e5d04d00 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:38:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:38:04 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:38:04 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 1073741824 Jul 05 18:38:04 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Flow 'volume_create_manager' (e9828712-eb24-412f-b0d4-96b46eb11724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ea9177-b34b-4363-ab7a-3d135aad0444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5ea9177-b34b-4363-ab7a-3d135aad0444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1551726708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b210718a0b43838f7bd003f8c5914b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:38:04Z,use_quota=True,user_id='692d07c6af9b4fa7a51d60ad7947d762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78d8be1-119c-48b4-8577-ee08b3154a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78d8be1-119c-48b4-8577-ee08b3154a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb8e6fe-9839-405a-bf14-a28201414ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb8e6fe-9839-405a-bf14-a28201414ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9', 'volume_name': 'volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c19ca8-e468-42fc-bfb2-26d587f9f39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c19ca8-e468-42fc-bfb2-26d587f9f39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11357726-56e6-4752-888a-404333e30e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Volume 3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9', 'volume_size': 1} Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:38:04 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 05 18:38:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 1073741824" returned: 0 in 0.972s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:38:05 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 Jul 05 18:38:05 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:38:05 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00" returned: 0 in 0.728s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.374s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1551726708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b210718a0b43838f7bd003f8c5914b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:38:04Z,use_quota=True,user_id='692d07c6af9b4fa7a51d60ad7947d762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Creating volume 3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:38:05 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:38:05 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 1073741824 Jul 05 18:38:05 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77edbf5-ac49-4415-9d12-04bb7b804c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6833d7a5-78bc-4913-be29-0e66e5d04d00', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d5c322-12f9-4698-8d17-463e3f66807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:05 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Volume volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 (6833d7a5-78bc-4913-be29-0e66e5d04d00): created successfully Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d5c322-12f9-4698-8d17-463e3f66807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Flow 'volume_create_manager' (9e617d99-2772-4768-970c-d794689c7c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:38:05 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-530f7e5a-9310-4e5f-ba3e-91691cdbccc8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Created volume successfully. Jul 05 18:38:06 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 05 18:38:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 1073741824" returned: 0 in 0.927s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:38:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:38:06 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 Jul 05 18:38:06 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:38:07 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 05 18:38:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9" returned: 0 in 0.710s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:38:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:38:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:38:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11357726-56e6-4752-888a-404333e30e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ab6dd3-e15c-436a-8ffe-63243aff9674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:38:07 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Volume volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 (3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9): created successfully Jul 05 18:38:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ab6dd3-e15c-436a-8ffe-63243aff9674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:38:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Flow 'volume_create_manager' (e9828712-eb24-412f-b0d4-96b46eb11724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:38:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e2f16646-26a9-41a4-b461-c830b5450309 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Created volume successfully. Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:38:12 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:38:12 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:38:12 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.801s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:38:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:38:17 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:38:17 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=2 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:38:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-18759632-b4b5-4e7f-b9b1-7eee01ac9bd2 req-231dbb5d-ab42-475a-948d-4c829a7cf9d9 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:38:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-18759632-b4b5-4e7f-b9b1-7eee01ac9bd2 req-231dbb5d-ab42-475a-948d-4c829a7cf9d9 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:38:47 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8951a54-2bc5-477f-bcb3-1d469f5153f9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:38:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-18759632-b4b5-4e7f-b9b1-7eee01ac9bd2 req-231dbb5d-ab42-475a-948d-4c829a7cf9d9 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:38:47 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 Jul 05 18:38:47 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:38:47 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 05 18:38:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-18759632-b4b5-4e7f-b9b1-7eee01ac9bd2 req-231dbb5d-ab42-475a-948d-4c829a7cf9d9 tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00" returned: 0 in 0.768s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:38:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-18759632-b4b5-4e7f-b9b1-7eee01ac9bd2 req-231dbb5d-ab42-475a-948d-4c829a7cf9d9 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.784s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:38:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-18759632-b4b5-4e7f-b9b1-7eee01ac9bd2 req-231dbb5d-ab42-475a-948d-4c829a7cf9d9 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-6833d7a5-78bc-4913-be29-0e66e5d04d00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10b9916d-4334-4375-8481-f69ba76790b0', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:38:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-18759632-b4b5-4e7f-b9b1-7eee01ac9bd2 req-231dbb5d-ab42-475a-948d-4c829a7cf9d9 tempest-TestServerVolumeAttachmentScenario-1120317435 None] attachment_update completed successfully. Jul 05 18:38:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-93a42331-d81f-4929-93b6-7b3f7320ec1f req-aaf4bc6d-85bd-4894-ac54-797dd0fe149c tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:38:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-93a42331-d81f-4929-93b6-7b3f7320ec1f req-aaf4bc6d-85bd-4894-ac54-797dd0fe149c tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:38:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d609d-294b-4867-8e32-1c2d9c76e417]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:38:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-93a42331-d81f-4929-93b6-7b3f7320ec1f req-aaf4bc6d-85bd-4894-ac54-797dd0fe149c tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:38:56 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 Jul 05 18:38:56 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:38:57 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 05 18:38:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-93a42331-d81f-4929-93b6-7b3f7320ec1f req-aaf4bc6d-85bd-4894-ac54-797dd0fe149c tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9" returned: 0 in 0.833s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:38:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-93a42331-d81f-4929-93b6-7b3f7320ec1f req-aaf4bc6d-85bd-4894-ac54-797dd0fe149c tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:38:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-93a42331-d81f-4929-93b6-7b3f7320ec1f req-aaf4bc6d-85bd-4894-ac54-797dd0fe149c tempest-TestServerVolumeAttachmentScenario-1120317435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acc9337d-a8c2-4406-aac7-c5c0fb58b2f8', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:38:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-93a42331-d81f-4929-93b6-7b3f7320ec1f req-aaf4bc6d-85bd-4894-ac54-797dd0fe149c tempest-TestServerVolumeAttachmentScenario-1120317435 None] attachment_update completed successfully. Jul 05 18:39:03 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-b147074f-4c5a-436d-8b92-d48f5f7e99d6 req-8ce7d9c4-190e-4089-9a8f-db0fc9499c7b tempest-TestServerVolumeAttachmentScenario-1120317435 None] Terminate volume connection completed successfully. Jul 05 18:39:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-b147074f-4c5a-436d-8b92-d48f5f7e99d6 req-8ce7d9c4-190e-4089-9a8f-db0fc9499c7b tempest-TestServerVolumeAttachmentScenario-1120317435 None] Deleting attachment acc9337d-a8c2-4406-aac7-c5c0fb58b2f8. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:39:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-eb5f7224-01fd-4168-9c2c-226097851720 req-66e28f71-00da-4868-8950-3f87c604d8c8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Terminate volume connection completed successfully. Jul 05 18:39:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-eb5f7224-01fd-4168-9c2c-226097851720 req-66e28f71-00da-4868-8950-3f87c604d8c8 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Deleting attachment 10b9916d-4334-4375-8481-f69ba76790b0. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:12 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:39:12 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:12 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.711s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:39:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:39:17 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:39:17 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=15,cinder:UPDATE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:39:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "cinder-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:39:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "cinder-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:39:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "cinder-quobyte-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:39:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "cinder-quobyte-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:39:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9fefd1-e6a2-48db-9889-83c48c75fef8]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:39:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:17 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 Jul 05 18:39:17 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:18 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9" returned: 0 in 0.794s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:18 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9 Jul 05 18:39:18 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:19 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9" returned: 0 in 0.741s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "cinder-quobyte-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9" released by "delete_volume" :: held 1.573s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Created reservations ['3031a897-acdd-4afc-9985-9cc3a0523921', '68479daa-4fa0-42ac-b42d-3ffe30a6389f', 'cf12d23a-a126-422c-a147-b05e793e1a39', '07459696-ebb1-453f-9fb3-337521498790'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:19 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:39:19 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "cinder-6833d7a5-78bc-4913-be29-0e66e5d04d00-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "cinder-6833d7a5-78bc-4913-be29-0e66e5d04d00-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "cinder-quobyte-6833d7a5-78bc-4913-be29-0e66e5d04d00" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "cinder-quobyte-6833d7a5-78bc-4913-be29-0e66e5d04d00" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece9e577-e4fe-44ee-a19d-9a85eab6a78c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:19 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.708s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:39:19 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Deleted volume successfully. Jul 05 18:39:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6e42e948-26e6-494c-bb06-475d4db70b12 tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "cinder-3acf0b6f-077a-4d1e-9b3b-0b5bb7c2ccf9-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:39:19 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 Jul 05 18:39:19 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:20 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00" returned: 0 in 0.807s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:20 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00 Jul 05 18:39:20 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:21 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-6833d7a5-78bc-4913-be29-0e66e5d04d00" returned: 0 in 0.658s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "cinder-quobyte-6833d7a5-78bc-4913-be29-0e66e5d04d00" released by "delete_volume" :: held 1.518s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:39:21 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Created reservations ['5f820e5c-6491-47f2-9430-d08ea9561684', '84cc5de2-d344-4b65-a26d-81b63af6e043', 'e57e23b0-bd81-48bf-8768-bb7d527331ca', '4ccb6994-ec51-4398-85d0-ba5677345770'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:39:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:39:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:39:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:39:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:39:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:39:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:21 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:39:21 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:22 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.657s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:22 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:39:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Deleted volume successfully. Jul 05 18:39:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-11be6e65-68ba-450f-b37a-dff0f3b3231f tempest-TestServerVolumeAttachmentScenario-1120317435 None] Lock "cinder-6833d7a5-78bc-4913-be29-0e66e5d04d00-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:39:31 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=15,cinder:SELECT=10,cinder:INSERT=3 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:39:32 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=11,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:39:53 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:39:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Flow 'volume_create_manager' (1abdc6f6-d418-49d3-b44c-42030c3d6e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:39:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7869d550-77cd-415b-8873-32379c9c402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:39:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7869d550-77cd-415b-8873-32379c9c402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1010874127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c760e0eb-af67-4278-a3af-f559840fd6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb431f1b0db748bdbae03eeda5f55a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:39:54Z,use_quota=True,user_id='ee033e9d5df743ad8150b1932e5d5ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:39:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55680ff7-1d08-4201-9a76-cef1fa63fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:39:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55680ff7-1d08-4201-9a76-cef1fa63fd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167e4445-23c0-4b72-bf30-828be286bda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG cinder.image.glance [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Creating Keystone auth plugin from conf {{(pid=86664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167e4445-23c0-4b72-bf30-828be286bda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c760e0eb-af67-4278-a3af-f559840fd6b2', 'volume_name': 'volume-c760e0eb-af67-4278-a3af-f559840fd6b2', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc862c7a-5daa-418f-96ad-32c45625307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc862c7a-5daa-418f-96ad-32c45625307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef4ce71-06b3-4204-83df-763c98ea8b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:39:54 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Volume c760e0eb-af67-4278-a3af-f559840fd6b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c760e0eb-af67-4278-a3af-f559840fd6b2', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Trying to clone c760e0eb-af67-4278-a3af-f559840fd6b2 from image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]). {{(pid=86664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 18:39:54 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Image download 20.69 MB at 20.69 MB/s Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b807da2b-832d-474b-8c28-aa9b17557128]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:39:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:54 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD Jul 05 18:39:54 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:55 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:55 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Temporary image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 is fetched for user ee033e9d5df743ad8150b1932e5d5ce1. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 18:39:55 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf422bf-98ec-4efa-9e31-d70201cf240c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:39:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:55 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD Jul 05 18:39:55 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:56 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1010874127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c760e0eb-af67-4278-a3af-f559840fd6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb431f1b0db748bdbae03eeda5f55a93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:39:54Z,use_quota=True,user_id='ee033e9d5df743ad8150b1932e5d5ce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Creating volume c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:39:56 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:39:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:56 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 1073741824 Jul 05 18:39:56 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:57 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 1073741824" returned: 0 in 0.830s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:57 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:39:57 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:57 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 0 in 0.634s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:39:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:39:57 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Attempting download of 8ef91c9d-cbe2-449c-b464-74cfa5f50992 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}])) to volume c760e0eb-af67-4278-a3af-f559840fd6b2. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 18:39:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6eba5d-fa66-40b6-bfcf-fa6366b20b5a]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:39:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_v94q91n3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:58 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_v94q91n3 Jul 05 18:39:58 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:58 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_v94q91n3" returned: 0 in 0.692s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_v94q91n3 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:58 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_v94q91n3 Jul 05 18:39:58 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:39:59 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Jul 05 18:39:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_v94q91n3" returned: 1 in 0.768s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:39:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ef91c9d-cbe2-449c-b464-74cfa5f50992_v94q91n3' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:39:59 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b28aedc-b9da-48ef-b023-0bdb1611b228]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:39:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:39:59 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD Jul 05 18:39:59 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:00 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:00 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] 8ef91c9d-cbe2-449c-b464-74cfa5f50992 was qcow2, converting to raw {{(pid=86664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 18:40:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:40:00 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:40:00 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:02 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 0 in 1.987s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:02 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ef91c9d-cbe2-449c-b464-74cfa5f50992_ijs7vvpcdevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:40:02 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Converted 112.00 MB image at 56.31 MB/s Jul 05 18:40:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:40:02 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 1G Jul 05 18:40:02 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:02 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 1G" returned: 0 in 0.704s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:02 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d41b2e9-5112-44d8-9a50-8a226b0a4ab6]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:40:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:40:02 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:40:02 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:03 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 0 in 0.754s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:40:03 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:40:03 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:04 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 1 in 0.702s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Downloaded image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}])) to volume c760e0eb-af67-4278-a3af-f559840fd6b2 successfully. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Temporary image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 for user ee033e9d5df743ad8150b1932e5d5ce1 is deleted. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Marking volume c760e0eb-af67-4278-a3af-f559840fd6b2 as bootable. {{(pid=86664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Copying metadata from image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 to c760e0eb-af67-4278-a3af-f559840fd6b2. {{(pid=86664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Creating volume glance metadata for volume c760e0eb-af67-4278-a3af-f559840fd6b2 backed by image 8ef91c9d-cbe2-449c-b464-74cfa5f50992 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef4ce71-06b3-4204-83df-763c98ea8b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c760e0eb-af67-4278-a3af-f559840fd6b2', 'volume_size': 1, 'image_id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b7a28b46fbbb44d7b097c1beec6a7265', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ef91c9d-cbe2-449c-b464-74cfa5f50992', 'created_at': datetime.datetime(2026, 7, 5, 16, 10, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 10, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ef91c9d-cbe2-449c-b464-74cfa5f50992/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e439a6-a20f-404f-a3ed-a12e4d9bb688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:40:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Volume volume-c760e0eb-af67-4278-a3af-f559840fd6b2 (c760e0eb-af67-4278-a3af-f559840fd6b2): created successfully Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e439a6-a20f-404f-a3ed-a12e4d9bb688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:40:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Flow 'volume_create_manager' (1abdc6f6-d418-49d3-b44c-42030c3d6e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:40:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d3dd0fd6-95a2-4ba3-945c-3f0eecebb033 tempest-TestShelveInstance-1713094340 None] Created volume successfully. Jul 05 18:40:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:40:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:40:11 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d28d9e-7b44-4a43-9965-90eac7af1211]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:40:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:40:11 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:40:11 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:40:12 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:40:12 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:12 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 0 in 0.814s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:40:12 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:40:12 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:12 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.734s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:40:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:40:13 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 1 in 0.765s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:40:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.629s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:40:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-c760e0eb-af67-4278-a3af-f559840fd6b2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03f1cceb-cb2e-4aaf-b7aa-e987c8385a46', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:40:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-0cc599c2-dd5d-413b-b0a7-91c1e7329834 req-18973091-9454-4f0b-ab45-b9b1a5dd3560 tempest-TestShelveInstance-1713094340 None] attachment_update completed successfully. Jul 05 18:40:23 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=5 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:40:23 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=7,cinder:SELECT=11,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:40:50 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-cdae20ae-551b-4e95-8eaf-9d1a82045dcd req-6208f841-c894-4ecc-b64c-72f3cf83dbfe tempest-TestShelveInstance-1713094340 None] Terminate volume connection completed successfully. Jul 05 18:40:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-cdae20ae-551b-4e95-8eaf-9d1a82045dcd req-6208f841-c894-4ecc-b64c-72f3cf83dbfe tempest-TestShelveInstance-1713094340 None] Deleting attachment 03f1cceb-cb2e-4aaf-b7aa-e987c8385a46. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:40:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:40:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:40:55 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f322c603-ac67-4840-bafc-5721c9fbc82e]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:40:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:40:55 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:40:55 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:55 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 0 in 0.773s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:40:55 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:40:55 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:40:56 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jul 05 18:40:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 1 in 0.722s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:40:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:40:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.535s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:40:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae', 'name': 'volume-c760e0eb-af67-4278-a3af-f559840fd6b2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92b70b01-9623-4f46-a3d6-9452e44ae7d2', 'enforce_multipath': True} {{(pid=86664) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 05 18:40:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-c6dfa102-a119-49be-bbef-4f8b4eebefb2 req-5c67fe57-1cd5-44fb-b578-ad7cda299792 tempest-TestShelveInstance-1713094340 None] attachment_update completed successfully. Jul 05 18:41:06 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=5 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:41:06 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:41:12 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:41:12 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:41:12 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.667s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:41:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:41:27 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:41:27 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:41:49 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-dee91efd-6cf3-42ef-b9af-63730058ea92 tempest-TestShelveInstance-1713094340 None] Terminate volume connection completed successfully. Jul 05 18:41:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-dee91efd-6cf3-42ef-b9af-63730058ea92 tempest-TestShelveInstance-1713094340 None] Deleting attachment 92b70b01-9623-4f46-a3d6-9452e44ae7d2. {{(pid=86664) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 05 18:41:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Acquiring lock "cinder-c760e0eb-af67-4278-a3af-f559840fd6b2-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:41:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Lock "cinder-c760e0eb-af67-4278-a3af-f559840fd6b2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:41:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Acquiring lock "cinder-quobyte-c760e0eb-af67-4278-a3af-f559840fd6b2" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:41:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Lock "cinder-quobyte-c760e0eb-af67-4278-a3af-f559840fd6b2" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:41:50 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2811b12b-4f05-4580-a110-0c30f4efa563]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:41:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:41:50 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:41:50 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:41:51 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 05 18:41:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 0 in 0.736s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:41:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:41:51 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:41:51 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:41:52 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 1 in 0.811s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:41:52 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2 Jul 05 18:41:52 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:41:52 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c760e0eb-af67-4278-a3af-f559840fd6b2" returned: 0 in 0.662s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Lock "cinder-quobyte-c760e0eb-af67-4278-a3af-f559840fd6b2" released by "delete_volume" :: held 2.288s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG cinder.quota [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Created reservations ['c3e30ae4-e784-4557-bba0-063a56c46132', 'd59cd549-0e16-4a41-96af-e233dfa88bd9', 'ee288dc8-12d8-4fd9-a96a-2ce83496ccb9', '1bf10e50-90df-4fde-9a64-5f6113170ae4'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:41:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:41:52 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:41:52 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:41:53 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 05 18:41:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.683s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:41:53 devstack cinder-volume[86664]: DEBUG cinder.manager [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:41:53 devstack cinder-volume[86664]: INFO cinder.volume.manager [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Deleted volume successfully. Jul 05 18:41:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [req-d31fca0a-b878-42a8-89a3-d81c66ba7f75 req-e4eff2c6-22a3-412d-873f-aa55a8ca65e1 tempest-TestShelveInstance-1713094340 None] Lock "cinder-c760e0eb-af67-4278-a3af-f559840fd6b2-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:02 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:42:03 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Flow 'volume_create_manager' (561b0971-47b7-4816-8d61-2bbae1eca33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfe6e0c-6ec7-4f5f-91db-ed81334cccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfe6e0c-6ec7-4f5f-91db-ed81334cccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e4ac3f-9229-4cb7-8f34-07ea7941091f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf3f17676bd49a9ab7b8362f6e4d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:05Z,use_quota=True,user_id='d3f002b56e7248efac2c6d1e64632195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cb798b-e7bc-400f-a44d-493aae308fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cb798b-e7bc-400f-a44d-493aae308fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c649904-4861-49da-add6-08335c9888c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c649904-4861-49da-add6-08335c9888c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e4ac3f-9229-4cb7-8f34-07ea7941091f', 'volume_name': 'volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0061f0c0-c36f-42de-aa32-cf901f6de6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0061f0c0-c36f-42de-aa32-cf901f6de6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c1099d-1c24-4b3b-8601-8c211746296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Volume 92e4ac3f-9229-4cb7-8f34-07ea7941091f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f', 'volume_size': 1} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92e4ac3f-9229-4cb7-8f34-07ea7941091f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf3f17676bd49a9ab7b8362f6e4d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:05Z,use_quota=True,user_id='d3f002b56e7248efac2c6d1e64632195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Creating volume 92e4ac3f-9229-4cb7-8f34-07ea7941091f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:42:04 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:42:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:04 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f 1073741824 Jul 05 18:42:04 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:05 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f 1073741824" returned: 0 in 0.780s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:05 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f Jul 05 18:42:05 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:06 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f" returned: 0 in 0.603s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:42:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c1099d-1c24-4b3b-8601-8c211746296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f34659-fd0f-4c93-90b7-292f4dd5a420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:06 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Volume volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f (92e4ac3f-9229-4cb7-8f34-07ea7941091f): created successfully Jul 05 18:42:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f34659-fd0f-4c93-90b7-292f4dd5a420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Flow 'volume_create_manager' (561b0971-47b7-4816-8d61-2bbae1eca33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:06 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ae0ae77a-c335-4005-a23f-d3a30ed8738a tempest-CinderUnicodeTest-1485658663 None] Created volume successfully. Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Flow 'volume_create_manager' (05bb1313-5ea5-45b9-b963-ab14068c4900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5d914-61e0-465d-95dd-bbe12cc3f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e5d914-61e0-465d-95dd-bbe12cc3f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1163097656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4b46e3-2cea-4443-a80d-6c9136b6c65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf3f17676bd49a9ab7b8362f6e4d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:07Z,use_quota=True,user_id='d3f002b56e7248efac2c6d1e64632195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35b4ae6-1978-40fd-9f3f-cb4999ed981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35b4ae6-1978-40fd-9f3f-cb4999ed981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e867d248-ace1-45c7-a1d3-25699279de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e867d248-ace1-45c7-a1d3-25699279de97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e4b46e3-2cea-4443-a80d-6c9136b6c65d', 'volume_name': 'volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57cd62a-87b3-4c50-8da2-2a954ec30548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57cd62a-87b3-4c50-8da2-2a954ec30548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c22931-99bb-4a4a-afbb-7faa8de70f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:07 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Volume 4e4b46e3-2cea-4443-a80d-6c9136b6c65d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d', 'volume_size': 1} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1163097656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e4b46e3-2cea-4443-a80d-6c9136b6c65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bf3f17676bd49a9ab7b8362f6e4d264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:07Z,use_quota=True,user_id='d3f002b56e7248efac2c6d1e64632195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Creating volume 4e4b46e3-2cea-4443-a80d-6c9136b6c65d {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:42:07 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:42:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:07 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d 1073741824 Jul 05 18:42:07 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:08 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d 1073741824" returned: 0 in 0.804s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:08 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d Jul 05 18:42:08 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:08 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" returned: 0 in 0.631s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:42:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c22931-99bb-4a4a-afbb-7faa8de70f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589aede8-f1f8-4eaf-b943-76986c295b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:08 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Volume volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d (4e4b46e3-2cea-4443-a80d-6c9136b6c65d): created successfully Jul 05 18:42:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589aede8-f1f8-4eaf-b943-76986c295b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Flow 'volume_create_manager' (05bb1313-5ea5-45b9-b963-ab14068c4900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:08 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fa44b029-7f25-43f6-af62-419c8cd090e1 tempest-CinderUnicodeTest-1485658663 None] Created volume successfully. Jul 05 18:42:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Creating offline snapshot aac80b47-d93e-4e6a-ae03-ce2e59a4221a of volume 4e4b46e3-2cea-4443-a80d-6c9136b6c65d {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:42:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e5eef7-2cee-4791-b827-ce49ecc9c6bf]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:09 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d Jul 05 18:42:09 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:10 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" returned: 0 in 0.740s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:10 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a 1G Jul 05 18:42:10 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:11 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a 1G" returned: 0 in 0.813s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:11 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a Jul 05 18:42:11 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:11 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a" returned: 0 in 0.719s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:11 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a is being set with open permissions: ugo+rw Jul 05 18:42:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:11 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a Jul 05 18:42:11 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:12 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:42:12 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:12 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a" returned: 0 in 0.616s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:12 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.info Jul 05 18:42:12 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:12 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.754s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:42:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:42:13 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.info" returned: 0 in 0.616s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:13 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.info is being set with open permissions: ugo+rw Jul 05 18:42:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:13 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.info Jul 05 18:42:13 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:13 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.info" returned: 0 in 0.607s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.198s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-de744b68-1f6a-4b82-974a-8ac9eaa70959 tempest-CinderUnicodeTest-1485658663 None] Create snapshot completed successfully Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "cinder-aac80b47-d93e-4e6a-ae03-ce2e59a4221a-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-aac80b47-d93e-4e6a-ae03-ce2e59a4221a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "cinder-quobyte-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-quobyte-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "cinder-quobyte-aac80b47-d93e-4e6a-ae03-ce2e59a4221a" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-quobyte-aac80b47-d93e-4e6a-ae03-ce2e59a4221a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Deleting offline snapshot aac80b47-d93e-4e6a-ae03-ce2e59a4221a of volume 4e4b46e3-2cea-4443-a80d-6c9136b6c65d {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] snapshot_file for this snap is: volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d77d97-c89d-475c-aef7-c22f3a8fdc0b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:14 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a Jul 05 18:42:14 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:15 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a" returned: 0 in 0.743s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:42:15 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e5e62c-c8b2-47b8-aa82-98b8d1c1d132]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:15 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d Jul 05 18:42:15 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:16 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" returned: 0 in 0.727s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:16 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a Jul 05 18:42:16 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:17 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a" returned: 0 in 0.728s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:17 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a Jul 05 18:42:17 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:17 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d.aac80b47-d93e-4e6a-ae03-ce2e59a4221a" returned: 0 in 0.645s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-quobyte-aac80b47-d93e-4e6a-ae03-ce2e59a4221a" released by "_delete_snapshot" :: held 2.945s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-quobyte-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" released by "delete_snapshot" :: held 2.966s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Created reservations ['99900af8-3a69-4b02-a7ac-4731e45bcb3f', '11ca5bb2-2524-4251-97bf-f0e60099966b', '446ceff9-43f1-4747-ab3e-9bb0bf21de80', 'afe8d1c3-25cb-4f49-9421-a01126312566'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:42:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Delete snapshot completed successfully. Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0abebd23-70fb-4365-a6ac-b7fa871ee84e tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-aac80b47-d93e-4e6a-ae03-ce2e59a4221a-delete_snapshot" released by "delete_snapshot" :: held 3.116s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "cinder-4e4b46e3-2cea-4443-a80d-6c9136b6c65d-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-4e4b46e3-2cea-4443-a80d-6c9136b6c65d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "cinder-quobyte-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-quobyte-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:18 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c48d40f-3e1a-478b-984d-a6deb5fd4a5d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:18 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d Jul 05 18:42:18 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:18 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" returned: 0 in 0.837s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:18 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d Jul 05 18:42:18 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:19 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" returned: 0 in 0.623s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-quobyte-4e4b46e3-2cea-4443-a80d-6c9136b6c65d" released by "delete_volume" :: held 1.517s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:19 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Created reservations ['5b1501bb-d10f-4b31-9dc4-218f3a2c1d42', 'a145be23-af5b-47c5-9d8d-7ae47a8ba06e', '2cfb38b2-d637-4f01-8bfa-ad639b605d0d', '402b43ff-359a-41ee-a95d-6bddb40a58b2'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:42:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:19 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:42:19 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "cinder-92e4ac3f-9229-4cb7-8f34-07ea7941091f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-92e4ac3f-9229-4cb7-8f34-07ea7941091f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "cinder-quobyte-92e4ac3f-9229-4cb7-8f34-07ea7941091f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-quobyte-92e4ac3f-9229-4cb7-8f34-07ea7941091f" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:20 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66b75f6-838f-47cb-b0f5-0ecc595307ac]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:20 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.681s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:20 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:42:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Deleted volume successfully. Jul 05 18:42:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b1073821-1911-4419-b54e-bb2364205ecc tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-4e4b46e3-2cea-4443-a80d-6c9136b6c65d-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:20 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f Jul 05 18:42:20 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:21 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f" returned: 0 in 0.770s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:21 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f Jul 05 18:42:21 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:21 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-92e4ac3f-9229-4cb7-8f34-07ea7941091f" returned: 0 in 0.646s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-quobyte-92e4ac3f-9229-4cb7-8f34-07ea7941091f" released by "delete_volume" :: held 1.465s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Created reservations ['807650c3-2662-4e21-9f6b-a6e5c029b6db', 'ac603f07-46a3-4240-a20f-d37aaab03eaf', 'a091d62e-f900-4cee-a1d6-758e89201507', '947b9c78-c4ed-4263-9d98-153a08f22784'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:21 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:42:21 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:22 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.657s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:22 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:42:22 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Deleted volume successfully. Jul 05 18:42:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c838040f-e525-43a9-a21e-4438efbce246 tempest-CinderUnicodeTest-1485658663 None] Lock "cinder-92e4ac3f-9229-4cb7-8f34-07ea7941091f-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Flow 'volume_create_manager' (63f08084-3b17-4161-88eb-370e41f9d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce0d305-515d-41f7-a15a-896fccc1f060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce0d305-515d-41f7-a15a-896fccc1f060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262073914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5dc907-cb95-4857-9b3c-3ec0177b5d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e5562394cc46ed9f08b5c835f92848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:26Z,use_quota=True,user_id='d7aa1d9301674c80b0a6c4cadc34fcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e285e1-e355-423d-a891-4837a2792498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e285e1-e355-423d-a891-4837a2792498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2877e56-e7e6-41d6-91cd-ec920aac7fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2877e56-e7e6-41d6-91cd-ec920aac7fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5dc907-cb95-4857-9b3c-3ec0177b5d42', 'volume_name': 'volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab132314-3a15-4f80-a7de-48523f88ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab132314-3a15-4f80-a7de-48523f88ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958156a9-25c0-406f-bb9b-c8d982fa2f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:25 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Volume 2b5dc907-cb95-4857-9b3c-3ec0177b5d42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42', 'volume_size': 1} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262073914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5dc907-cb95-4857-9b3c-3ec0177b5d42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e5562394cc46ed9f08b5c835f92848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:26Z,use_quota=True,user_id='d7aa1d9301674c80b0a6c4cadc34fcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Creating volume 2b5dc907-cb95-4857-9b3c-3ec0177b5d42 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:42:25 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:42:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:25 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 1073741824 Jul 05 18:42:25 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:26 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 1073741824" returned: 0 in 0.784s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:26 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 Jul 05 18:42:26 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:27 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42" returned: 0 in 0.623s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:42:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958156a9-25c0-406f-bb9b-c8d982fa2f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beef7268-df4d-4d87-b524-0050aa1d56c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:27 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Volume volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 (2b5dc907-cb95-4857-9b3c-3ec0177b5d42): created successfully Jul 05 18:42:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beef7268-df4d-4d87-b524-0050aa1d56c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Flow 'volume_create_manager' (63f08084-3b17-4161-88eb-370e41f9d586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c37eef7f-185e-4238-a4bc-f7917e6ab964 tempest-ProjectReaderTests-1542543426 None] Created volume successfully. Jul 05 18:42:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "cinder-2b5dc907-cb95-4857-9b3c-3ec0177b5d42-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Lock "cinder-2b5dc907-cb95-4857-9b3c-3ec0177b5d42-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "cinder-quobyte-2b5dc907-cb95-4857-9b3c-3ec0177b5d42" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Lock "cinder-quobyte-2b5dc907-cb95-4857-9b3c-3ec0177b5d42" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:28 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[26632b04-3e76-4d08-bee5-d9bbcf338f73]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:28 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 Jul 05 18:42:28 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:28 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42" returned: 0 in 0.817s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:29 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42 Jul 05 18:42:29 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:29 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b5dc907-cb95-4857-9b3c-3ec0177b5d42" returned: 0 in 0.698s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Lock "cinder-quobyte-2b5dc907-cb95-4857-9b3c-3ec0177b5d42" released by "delete_volume" :: held 1.557s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:29 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Created reservations ['5ce37d2b-6857-4fb6-9b77-054843de4e5f', '52b0d5bf-be67-4e66-93f6-03225d5fb677', 'e1c5a35a-af11-4ab1-bb8d-7c8021c3d2fc', 'c4b743ca-969d-4796-b623-ac7db778051d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:42:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:29 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:42:29 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:30 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.669s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:42:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Deleted volume successfully. Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-94b117df-fbbb-4333-80be-3e55c145b963 tempest-ProjectReaderTests-1542543426 None] Lock "cinder-2b5dc907-cb95-4857-9b3c-3ec0177b5d42-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Flow 'volume_create_manager' (96125560-d8a2-4419-80df-38c5707f3a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3053e57-2304-43ef-a7bd-b1931985e329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3053e57-2304-43ef-a7bd-b1931985e329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801386932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e5562394cc46ed9f08b5c835f92848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:31Z,use_quota=True,user_id='d7aa1d9301674c80b0a6c4cadc34fcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea59325-4db7-4dfb-bce2-27e4f6d6441f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea59325-4db7-4dfb-bce2-27e4f6d6441f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2c1d76-5444-4483-ad66-6e043500351f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2c1d76-5444-4483-ad66-6e043500351f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7', 'volume_name': 'volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b150137-354b-4d48-aa0f-36e2da94acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b150137-354b-4d48-aa0f-36e2da94acf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efb3eff-13b9-4353-bfc5-d415dc04cd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:30 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Volume 63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7', 'volume_size': 1} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801386932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e5562394cc46ed9f08b5c835f92848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:31Z,use_quota=True,user_id='d7aa1d9301674c80b0a6c4cadc34fcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Creating volume 63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:42:30 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:42:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:30 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 1073741824 Jul 05 18:42:30 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:31 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 1073741824" returned: 0 in 0.868s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:31 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 Jul 05 18:42:31 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:32 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7" returned: 0 in 0.646s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efb3eff-13b9-4353-bfc5-d415dc04cd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a06a0a-4a83-41aa-b3fb-72ee0de58ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:32 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Volume volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 (63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7): created successfully Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a06a0a-4a83-41aa-b3fb-72ee0de58ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Flow 'volume_create_manager' (96125560-d8a2-4419-80df-38c5707f3a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8ac251fc-7357-4071-94b7-955b2accde72 tempest-ProjectReaderTests-1542543426 None] Created volume successfully. Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "cinder-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Lock "cinder-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "cinder-quobyte-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:42:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Lock "cinder-quobyte-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7" acquired by "delete_volume" :: waited 0.013s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:42:33 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e23196-df1f-4c34-9960-bf4f113ca508]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:33 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 Jul 05 18:42:33 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:33 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7" returned: 0 in 0.741s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:33 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7 Jul 05 18:42:33 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:34 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7" returned: 0 in 0.650s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Lock "cinder-quobyte-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7" released by "delete_volume" :: held 1.428s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:34 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Created reservations ['70aa7d8e-c817-491f-8653-0f9cca1b276d', 'b02a1524-02ca-45cb-89f9-f8d2fa1dc5af', '64d165ce-8fd8-4169-aaa0-4b226992b3f4', 'a9e521ba-0cc2-4761-9d73-394659be82f1'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:42:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:34 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:42:34 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:35 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.663s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:35 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:42:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Deleted volume successfully. Jul 05 18:42:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-67fb8036-8872-4f1b-acbf-299160664443 tempest-ProjectReaderTests-1542543426 None] Lock "cinder-63df1b0e-e427-4e8c-ba6f-bc9c8a2cc9e7-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:42:44 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=39,cinder:UPDATE=56,cinder:DELETE=2,cinder:INSERT=14 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:42:45 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=35,cinder:UPDATE=46,cinder:INSERT=11,cinder:DELETE=7 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (ca84f47a-0686-4fd5-9343-ead9ba661a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe45b63-c400-4d33-918d-ec7b66a4e100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe45b63-c400-4d33-918d-ec7b66a4e100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012750906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5461bfed-15d6-48ec-b5d6-62f6e651ad14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:52Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06459e0-0ba7-43bb-a8e6-527496ca51d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06459e0-0ba7-43bb-a8e6-527496ca51d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9faa75fa-3c19-47c7-b30f-a63aee77b75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9faa75fa-3c19-47c7-b30f-a63aee77b75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5461bfed-15d6-48ec-b5d6-62f6e651ad14', 'volume_name': 'volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd9356a-dc46-4811-9afe-337011693428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd9356a-dc46-4811-9afe-337011693428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f263501c-1379-422b-b7c3-d542c0f8a64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:52 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume 5461bfed-15d6-48ec-b5d6-62f6e651ad14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14', 'volume_size': 1} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012750906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5461bfed-15d6-48ec-b5d6-62f6e651ad14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:52Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Creating volume 5461bfed-15d6-48ec-b5d6-62f6e651ad14 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:42:52 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:42:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:52 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 1073741824 Jul 05 18:42:52 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Flow 'volume_create_manager' (c7f0e821-50f7-4ac0-87b1-5ed3cb602280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21aabe98-eda8-4be2-a594-20c47a060733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21aabe98-eda8-4be2-a594-20c47a060733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1712810456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a59adc-de06-42e2-ac2d-0f05d8111176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d7b0881cab4bfe9c13ef4113180a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:53Z,use_quota=True,user_id='e6b54c4bcaeb4c04b35146d016104015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35fac58-5d5b-45f6-950a-32736828700d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35fac58-5d5b-45f6-950a-32736828700d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89512a41-8beb-47be-a058-0051e6463550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89512a41-8beb-47be-a058-0051e6463550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a59adc-de06-42e2-ac2d-0f05d8111176', 'volume_name': 'volume-14a59adc-de06-42e2-ac2d-0f05d8111176', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f7f6e5-2ae4-4451-9cff-62bad5203ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f7f6e5-2ae4-4451-9cff-62bad5203ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e912b83-bbcf-4741-b3a4-79bb2e333957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:53 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Volume 14a59adc-de06-42e2-ac2d-0f05d8111176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a59adc-de06-42e2-ac2d-0f05d8111176', 'volume_size': 1} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:53 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 1073741824" returned: 0 in 1.032s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:53 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 Jul 05 18:42:53 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:54 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14" returned: 0 in 0.821s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.438s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1712810456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a59adc-de06-42e2-ac2d-0f05d8111176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d7b0881cab4bfe9c13ef4113180a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:53Z,use_quota=True,user_id='e6b54c4bcaeb4c04b35146d016104015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Creating volume 14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:42:54 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:54 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 1073741824 Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f263501c-1379-422b-b7c3-d542c0f8a64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:54 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3b5068-82c9-4dc5-b057-dbd405cf211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:54 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 (5461bfed-15d6-48ec-b5d6-62f6e651ad14): created successfully Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3b5068-82c9-4dc5-b057-dbd405cf211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (ca84f47a-0686-4fd5-9343-ead9ba661a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4c08817e-874b-46cf-a217-53d192b971a4 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created volume successfully. Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Flow 'volume_create_manager' (40c7471a-50e3-43b4-8bee-0bb1407fd08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba987bee-07ec-411a-ac82-5272c1f2ed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:55 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba987bee-07ec-411a-ac82-5272c1f2ed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce881f65-2c03-47e9-922f-bd750f6b8422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0184b320e68b4b26b7c9437c11aeb178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:56Z,use_quota=True,user_id='23a8466083ac4941a263a51706c1cf24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7b179f-9e42-4872-8bd8-ed3ba94b782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7b179f-9e42-4872-8bd8-ed3ba94b782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614cdd56-ada2-4083-9498-264a0b55b119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG cinder.image.glance [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Creating Keystone auth plugin from conf {{(pid=86664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 1073741824" returned: 0 in 1.097s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:55 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 Jul 05 18:42:55 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614cdd56-ada2-4083-9498-264a0b55b119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce881f65-2c03-47e9-922f-bd750f6b8422', 'volume_name': 'volume-ce881f65-2c03-47e9-922f-bd750f6b8422', 'volume_size': 1, 'image_id': 'f0375f3b-5898-45a9-959d-e55a05b494ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0375f3b-5898-45a9-959d-e55a05b494ac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2486e8da41c8e16c1f64aa63133ec810', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0184b320e68b4b26b7c9437c11aeb178', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ca2a0b0a553d39593042635834acd85643ff02050302697dcbc1cf06f454ed3298b60336ccc191705f505149b5767be6879396f2a4856e2dbeb78b7996e965c', 'id': 'f0375f3b-5898-45a9-959d-e55a05b494ac', 'created_at': datetime.datetime(2026, 7, 5, 16, 42, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 42, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0375f3b-5898-45a9-959d-e55a05b494ac/file', 'properties': {}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243877d4-3d47-4b08-9ebc-eb40fd5b4f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (243877d4-3d47-4b08-9ebc-eb40fd5b4f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0407050-54dc-44d8-8c7d-6bd2524eace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Volume ce881f65-2c03-47e9-922f-bd750f6b8422: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce881f65-2c03-47e9-922f-bd750f6b8422', 'volume_size': 1, 'image_id': 'f0375f3b-5898-45a9-959d-e55a05b494ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0375f3b-5898-45a9-959d-e55a05b494ac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2486e8da41c8e16c1f64aa63133ec810', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0184b320e68b4b26b7c9437c11aeb178', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ca2a0b0a553d39593042635834acd85643ff02050302697dcbc1cf06f454ed3298b60336ccc191705f505149b5767be6879396f2a4856e2dbeb78b7996e965c', 'id': 'f0375f3b-5898-45a9-959d-e55a05b494ac', 'created_at': datetime.datetime(2026, 7, 5, 16, 42, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 42, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0375f3b-5898-45a9-959d-e55a05b494ac/file', 'properties': {}}, 'image_service': } Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Trying to clone ce881f65-2c03-47e9-922f-bd750f6b8422 from image f0375f3b-5898-45a9-959d-e55a05b494ac at location (None, [{'url': 'file:///opt/stack/data/glance/images/f0375f3b-5898-45a9-959d-e55a05b494ac', 'metadata': {}}]). {{(pid=86664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 18:42:56 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Image download 0.00 MB at 0.00 MB/s Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4a6eac-a22f-4289-adcb-033228fc45ed]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:56 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD Jul 05 18:42:56 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:56 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176" returned: 0 in 0.702s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.613s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e912b83-bbcf-4741-b3a4-79bb2e333957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a59adc-de06-42e2-ac2d-0f05d8111176', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80c3edb-1938-46ca-a952-faae7c62f326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Creating offline snapshot 2cf089cd-6095-4b7b-a25d-95df4a18de55 of volume 5461bfed-15d6-48ec-b5d6-62f6e651ad14 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:42:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Volume volume-14a59adc-de06-42e2-ac2d-0f05d8111176 (14a59adc-de06-42e2-ac2d-0f05d8111176): created successfully Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80c3edb-1938-46ca-a952-faae7c62f326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Flow 'volume_create_manager' (c7f0e821-50f7-4ac0-87b1-5ed3cb602280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b1a2e5-5603-464d-96fb-120c3e338ac4]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4cabc4cc-1b79-40f8-a566-34755c0c61a2 tempest-VolumeDependencyTests-805716433 None] Created volume successfully. Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Flow 'volume_create_manager' (e3aa8850-efdc-4c86-ad3a-084bec942b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab1d854-eaf4-4b29-b848-5702833b3c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:56 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 Jul 05 18:42:56 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab1d854-eaf4-4b29-b848-5702833b3c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48d98a9-7fc0-4965-9908-ae89fecdcebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070d5384025a495f9f5bc1ae9f66bb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:57Z,use_quota=True,user_id='012ecddb422d4152b1df1bca51158f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5161facb-1009-477b-9fe3-9febe7eb5a6b),volume_type_id=5161facb-1009-477b-9fe3-9febe7eb5a6b)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac4930a-ace5-40ea-be5f-49dc5ec86cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac4930a-ace5-40ea-be5f-49dc5ec86cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006138b7-b630-44b4-a9ae-1530111ffaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:56 devstack cinder-volume[86664]: DEBUG cinder.image.glance [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Creating Keystone auth plugin from conf {{(pid=86664) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006138b7-b630-44b4-a9ae-1530111ffaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a48d98a9-7fc0-4965-9908-ae89fecdcebd', 'volume_name': 'volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd', 'volume_size': 1, 'image_id': '3f20c679-eeec-414e-a7ea-f594d57d34f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f20c679-eeec-414e-a7ea-f594d57d34f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc4e910fe57b62ead297399bef880c7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '070d5384025a495f9f5bc1ae9f66bb3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3427decc012df5cae4f6f41a983b1ad12a8f8f384bf1bdfa667c1d44b1ee2dc437131850245f9ce8c9cdfb1bc36fe033cabf8cabb33e5403c046c1a93dd20033', 'id': '3f20c679-eeec-414e-a7ea-f594d57d34f0', 'created_at': datetime.datetime(2026, 7, 5, 16, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f20c679-eeec-414e-a7ea-f594d57d34f0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20993182-2187-4bc5-b38f-4dcf8ac1af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20993182-2187-4bc5-b38f-4dcf8ac1af99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb1d606-34e2-4def-9d52-7cf880d6cc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:42:57 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Volume a48d98a9-7fc0-4965-9908-ae89fecdcebd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd', 'volume_size': 1, 'image_id': '3f20c679-eeec-414e-a7ea-f594d57d34f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f20c679-eeec-414e-a7ea-f594d57d34f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc4e910fe57b62ead297399bef880c7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '070d5384025a495f9f5bc1ae9f66bb3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3427decc012df5cae4f6f41a983b1ad12a8f8f384bf1bdfa667c1d44b1ee2dc437131850245f9ce8c9cdfb1bc36fe033cabf8cabb33e5403c046c1a93dd20033', 'id': '3f20c679-eeec-414e-a7ea-f594d57d34f0', 'created_at': datetime.datetime(2026, 7, 5, 16, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f20c679-eeec-414e-a7ea-f594d57d34f0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Trying to clone a48d98a9-7fc0-4965-9908-ae89fecdcebd from image 3f20c679-eeec-414e-a7ea-f594d57d34f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3f20c679-eeec-414e-a7ea-f594d57d34f0', 'metadata': {}}]). {{(pid=86664) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 05 18:42:57 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD" returned: 0 in 0.880s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 05 18:42:57 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Image download 0.00 MB at 0.00 MB/s Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[706a92fd-cb66-4aec-b58c-5ccae3a773d6]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:57 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD Jul 05 18:42:57 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:57 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD Jul 05 18:42:57 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:57 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14" returned: 0 in 0.879s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:57 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 1G Jul 05 18:42:57 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:42:58 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:58 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD" returned: 1 in 1.063s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Temporary image f0375f3b-5898-45a9-959d-e55a05b494ac is fetched for user 23a8466083ac4941a263a51706c1cf24. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 18:42:58 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD Jul 05 18:42:58 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac92599a-61fa-4a8e-b15f-4872227dc075]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:58 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD Jul 05 18:42:58 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:58 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 1G" returned: 0 in 1.021s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:58 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 Jul 05 18:42:58 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:58 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD" returned: 1 in 0.724s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Temporary image 3f20c679-eeec-414e-a7ea-f594d57d34f0 is fetched for user 012ecddb422d4152b1df1bca51158f9b. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e15a1e-8474-462a-aa46-2d9970eae7e5]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:42:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:59 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD Jul 05 18:42:59 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:59 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD" returned: 0 in 0.922s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:59 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD Jul 05 18:42:59 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:59 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55" returned: 0 in 0.901s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:59 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 is being set with open permissions: ugo+rw Jul 05 18:42:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:59 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 Jul 05 18:42:59 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:59 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:42:59 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD Jul 05 18:42:59 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:42:59 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 05 18:42:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD" returned: 1 in 0.785s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:42:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:42:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:00 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55" returned: 0 in 0.743s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:00 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.info Jul 05 18:43:00 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:00 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD" returned: 1 in 0.870s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:43:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:00 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.info" returned: 0 in 0.711s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:00 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.info is being set with open permissions: ugo+rw Jul 05 18:43:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:00 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.info Jul 05 18:43:00 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:01 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.info" returned: 0 in 0.612s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.080s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.889s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Creating offline snapshot d6381eda-414b-4048-85df-203c355d90fe of volume 14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:43:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b7a4e7d9-314d-4586-b347-9e9b4bb51c9d tempest-CreateVolumesFromSnapshotTest-527062530 None] Create snapshot completed successfully Jul 05 18:43:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f0c48d-f7cc-4afa-8936-46868b14fea9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:01 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 Jul 05 18:43:01 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:02 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176" returned: 0 in 0.982s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:02 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe 1G Jul 05 18:43:02 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (f219aa80-e450-4830-8813-9980725cbdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367e2f26-2ee0-4efd-b5ff-9ea7d454bfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367e2f26-2ee0-4efd-b5ff-9ea7d454bfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963494591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5299273-7667-4b38-a742-d5f91a0e1cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:03Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48df9211-3bc1-4bd4-8e11-0d59f1b967e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48df9211-3bc1-4bd4-8e11-0d59f1b967e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4cbe0f-3a05-4682-8628-4436f9cd8f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4cbe0f-3a05-4682-8628-4436f9cd8f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5299273-7667-4b38-a742-d5f91a0e1cec', 'volume_name': 'volume-d5299273-7667-4b38-a742-d5f91a0e1cec', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d845e7-c0e6-48bd-9edf-bafabf6ae14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d845e7-c0e6-48bd-9edf-bafabf6ae14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05598c8f-df3d-44fb-babe-787db353f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:02 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume d5299273-7667-4b38-a742-d5f91a0e1cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5299273-7667-4b38-a742-d5f91a0e1cec', 'volume_size': 1} Jul 05 18:43:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (f8c9ae89-6554-4c97-9150-3ae5f9f1cebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3309f1-ca2b-4542-a2d7-6241fffae130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3309f1-ca2b-4542-a2d7-6241fffae130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-284704374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a517f7-6917-4df5-b330-73e9bf85c873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:03Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ff485a-582d-487d-ab37-fd3c6359ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ff485a-582d-487d-ab37-fd3c6359ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcacb9bd-faf0-4546-b31c-66f4798c4c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcacb9bd-faf0-4546-b31c-66f4798c4c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a517f7-6917-4df5-b330-73e9bf85c873', 'volume_name': 'volume-19a517f7-6917-4df5-b330-73e9bf85c873', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cfb94c-487d-4e70-872a-1e27f5259a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cfb94c-487d-4e70-872a-1e27f5259a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8621fd8b-8b28-4f61-8bac-ca631e7e95ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume 19a517f7-6917-4df5-b330-73e9bf85c873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a517f7-6917-4df5-b330-73e9bf85c873', 'volume_size': 1} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (3559b895-0aa0-440e-a2ba-aa4d596c60ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880a16e1-573a-4098-a066-16377db485d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880a16e1-573a-4098-a066-16377db485d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1133840814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed52e7bb-207f-4dc0-be84-987973efddaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:03Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8363f24-bafc-4890-8dc6-b7234e8b0bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8363f24-bafc-4890-8dc6-b7234e8b0bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad7393b-2c18-4aa4-9597-9d2f8bed9d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad7393b-2c18-4aa4-9597-9d2f8bed9d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed52e7bb-207f-4dc0-be84-987973efddaa', 'volume_name': 'volume-ed52e7bb-207f-4dc0-be84-987973efddaa', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc41827b-bd89-43e8-a9f6-5ef0e697ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc41827b-bd89-43e8-a9f6-5ef0e697ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad7939d-2bd3-48d4-adef-3d57c5e58570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume ed52e7bb-207f-4dc0-be84-987973efddaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed52e7bb-207f-4dc0-be84-987973efddaa', 'volume_size': 1} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:03 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe 1G" returned: 0 in 1.056s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a59adc-de06-42e2-ac2d-0f05d8111176 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:03 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a59adc-de06-42e2-ac2d-0f05d8111176 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe Jul 05 18:43:03 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (5690afe6-77f5-4ca4-9429-a07f9a710cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd51f08d-3bb3-402e-9681-c027190cccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd51f08d-3bb3-402e-9681-c027190cccba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1110239676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c14f37f-6390-4080-9e2d-8ded17e72782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:04Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9048b8c-fa48-48b4-bd08-aca4be7b3ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9048b8c-fa48-48b4-bd08-aca4be7b3ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c9b798-130b-47db-8fb6-020ebf9f94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c9b798-130b-47db-8fb6-020ebf9f94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c14f37f-6390-4080-9e2d-8ded17e72782', 'volume_name': 'volume-0c14f37f-6390-4080-9e2d-8ded17e72782', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7c96c6-d368-4bed-8d96-41df99d87a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f7c96c6-d368-4bed-8d96-41df99d87a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98008388-5491-4357-a26f-ab55a5d5bd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:03 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume 0c14f37f-6390-4080-9e2d-8ded17e72782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c14f37f-6390-4080-9e2d-8ded17e72782', 'volume_size': 1} Jul 05 18:43:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (eb704ee3-b241-4a7d-978e-9f0c2cc59816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf9f4e7-2d75-4f54-bf6a-ed35bfb2e276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf9f4e7-2d75-4f54-bf6a-ed35bfb2e276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1855172481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e586b6-2a47-4187-92c8-4fc5139bcb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:04Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30fe98d-d673-43a9-9da2-a4bf7e38549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30fe98d-d673-43a9-9da2-a4bf7e38549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ec0af0-4b84-4aab-b9ed-bb9358ec9dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ec0af0-4b84-4aab-b9ed-bb9358ec9dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e586b6-2a47-4187-92c8-4fc5139bcb57', 'volume_name': 'volume-83e586b6-2a47-4187-92c8-4fc5139bcb57', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b176f48-896b-4023-abc4-a0f403478130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b176f48-896b-4023-abc4-a0f403478130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685ae959-6226-46df-9161-7ab16e427373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume 83e586b6-2a47-4187-92c8-4fc5139bcb57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e586b6-2a47-4187-92c8-4fc5139bcb57', 'volume_size': 1} Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:04 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a59adc-de06-42e2-ac2d-0f05d8111176 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe" returned: 0 in 0.904s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:04 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe is being set with open permissions: ugo+rw Jul 05 18:43:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:04 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe Jul 05 18:43:04 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:05 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe" returned: 0 in 0.608s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:05 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.info Jul 05 18:43:05 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:05 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.info" returned: 0 in 0.627s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:05 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.info is being set with open permissions: ugo+rw Jul 05 18:43:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:05 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.info Jul 05 18:43:05 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:06 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.info" returned: 0 in 0.632s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.912s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.525s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce881f65-2c03-47e9-922f-bd750f6b8422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0184b320e68b4b26b7c9437c11aeb178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:56Z,use_quota=True,user_id='23a8466083ac4941a263a51706c1cf24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Creating volume ce881f65-2c03-47e9-922f-bd750f6b8422 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:06 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:06 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 1073741824 Jul 05 18:43:06 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:06 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-19e7d93d-b201-45b3-ba4d-a6fcee9c529b tempest-VolumeDependencyTests-805716433 None] Create snapshot completed successfully Jul 05 18:43:07 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 1073741824" returned: 0 in 0.918s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:07 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 Jul 05 18:43:07 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Flow 'volume_create_manager' (b767853c-3dd5-49ef-a0fd-5a24872fa00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494a7249-50d6-43f6-bffd-01f7c67f3bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494a7249-50d6-43f6-bffd-01f7c67f3bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-343323756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a43eff-e7b8-4351-8e27-492b9cd98762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09d7b0881cab4bfe9c13ef4113180a64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d6381eda-414b-4048-85df-203c355d90fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:08Z,use_quota=True,user_id='e6b54c4bcaeb4c04b35146d016104015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ddab37-55c3-4296-a64f-e03dd80be2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ddab37-55c3-4296-a64f-e03dd80be2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bf2d22-fce8-4697-a38b-3e23c54448b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66bf2d22-fce8-4697-a38b-3e23c54448b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64a43eff-e7b8-4351-8e27-492b9cd98762', 'volume_name': 'volume-64a43eff-e7b8-4351-8e27-492b9cd98762', 'volume_size': 1, 'snapshot_id': 'd6381eda-414b-4048-85df-203c355d90fe'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b50542-1f88-420d-a1cb-8c1669a01457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b50542-1f88-420d-a1cb-8c1669a01457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109893a3-eeed-4114-a5bd-16341c0d0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:07 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Volume 64a43eff-e7b8-4351-8e27-492b9cd98762: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64a43eff-e7b8-4351-8e27-492b9cd98762', 'volume_size': 1, 'snapshot_id': 'd6381eda-414b-4048-85df-203c355d90fe'} Jul 05 18:43:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:08 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422" returned: 0 in 0.684s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.532s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a48d98a9-7fc0-4965-9908-ae89fecdcebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070d5384025a495f9f5bc1ae9f66bb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:42:57Z,use_quota=True,user_id='012ecddb422d4152b1df1bca51158f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5161facb-1009-477b-9fe3-9febe7eb5a6b),volume_type_id=5161facb-1009-477b-9fe3-9febe7eb5a6b)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Creating volume a48d98a9-7fc0-4965-9908-ae89fecdcebd {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:08 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:08 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd 1073741824 Jul 05 18:43:08 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Attempting download of f0375f3b-5898-45a9-959d-e55a05b494ac ((None, [{'url': 'file:///opt/stack/data/glance/images/f0375f3b-5898-45a9-959d-e55a05b494ac', 'metadata': {}}])) to volume ce881f65-2c03-47e9-922f-bd750f6b8422. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[59efabfd-5f71-436e-954a-19868e116a14]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0375f3b-5898-45a9-959d-e55a05b494ac_v6kk7umk {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:08 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0375f3b-5898-45a9-959d-e55a05b494ac_v6kk7umk Jul 05 18:43:08 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:09 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f0375f3b-5898-45a9-959d-e55a05b494ac_v6kk7umk" returned: 0 in 0.788s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0375f3b-5898-45a9-959d-e55a05b494ac_v6kk7umk {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:09 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd 1073741824" returned: 0 in 0.884s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:09 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd Jul 05 18:43:09 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:09 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0375f3b-5898-45a9-959d-e55a05b494ac_v6kk7umk Jul 05 18:43:09 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:09 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd" returned: 0 in 0.667s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.022s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-963494591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5299273-7667-4b38-a742-d5f91a0e1cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:03Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Creating volume d5299273-7667-4b38-a742-d5f91a0e1cec {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:09 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:09 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0375f3b-5898-45a9-959d-e55a05b494ac_v6kk7umk" returned: 1 in 0.760s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f0375f3b-5898-45a9-959d-e55a05b494ac_v6kk7umk' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac6a9a5-a8ae-47ba-a415-639365c9ae6d]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:09 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec 1073741824 Jul 05 18:43:09 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Attempting download of 3f20c679-eeec-414e-a7ea-f594d57d34f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f20c679-eeec-414e-a7ea-f594d57d34f0', 'metadata': {}}])) to volume a48d98a9-7fc0-4965-9908-ae89fecdcebd. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1930ac5-4a4c-4409-b95b-641fb93b1c49]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f20c679-eeec-414e-a7ea-f594d57d34f0_31as7kju {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:09 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD Jul 05 18:43:09 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:09 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f20c679-eeec-414e-a7ea-f594d57d34f0_31as7kju Jul 05 18:43:09 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:10 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:10 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:10 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec 1073741824" returned: 0 in 0.901s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3f20c679-eeec-414e-a7ea-f594d57d34f0_31as7kju" returned: 0 in 0.807s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f20c679-eeec-414e-a7ea-f594d57d34f0_31as7kju {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:10 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD Jul 05 18:43:10 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:10 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec Jul 05 18:43:10 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:10 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f20c679-eeec-414e-a7ea-f594d57d34f0_31as7kju Jul 05 18:43:10 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:11 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec" returned: 0 in 0.652s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.274s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-284704374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a517f7-6917-4df5-b330-73e9bf85c873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:03Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Creating volume 19a517f7-6917-4df5-b330-73e9bf85c873 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:11 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:11 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:11 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873 1073741824 Jul 05 18:43:11 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05598c8f-df3d-44fb-babe-787db353f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5299273-7667-4b38-a742-d5f91a0e1cec', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef38815d-852d-4a02-83b0-0c6e73600584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:11 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD" returned: 1 in 0.913s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f20c679-eeec-414e-a7ea-f594d57d34f0_31as7kju" returned: 1 in 0.785s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3f20c679-eeec-414e-a7ea-f594d57d34f0_31as7kju' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] f0375f3b-5898-45a9-959d-e55a05b494ac was raw, converting to raw {{(pid=86664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[239bdb89-eeda-4fff-8f9d-c68d561a6235]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:11 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 Jul 05 18:43:11 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:11 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume volume-d5299273-7667-4b38-a742-d5f91a0e1cec (d5299273-7667-4b38-a742-d5f91a0e1cec): created successfully Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef38815d-852d-4a02-83b0-0c6e73600584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (f219aa80-e450-4830-8813-9980725cbdd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:11 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4f06e3bd-172a-4ce1-a606-121600cbe4b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created volume successfully. Jul 05 18:43:11 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD Jul 05 18:43:11 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:12 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:12 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:12 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422" returned: 0 in 0.842s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f0375f3b-5898-45a9-959d-e55a05b494ac_qxwrpiu7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:43:12 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:12 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 1G Jul 05 18:43:12 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:12 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:12 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873 1073741824" returned: 0 in 0.998s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:12 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873 Jul 05 18:43:12 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:12 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD Jul 05 18:43:12 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:12 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.729s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:43:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:43:13 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 1G" returned: 0 in 0.810s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1bb264-83cd-4cf1-8874-b423c1a4f85a]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:13 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873" returned: 0 in 0.790s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.740s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1133840814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed52e7bb-207f-4dc0-be84-987973efddaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:03Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Creating volume ed52e7bb-207f-4dc0-be84-987973efddaa {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:13 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:13 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:13 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 Jul 05 18:43:13 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD" returned: 1 in 0.896s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] 3f20c679-eeec-414e-a7ea-f594d57d34f0 was raw, converting to raw {{(pid=86664) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:13 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa 1073741824 Jul 05 18:43:13 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8621fd8b-8b28-4f61-8bac-ca631e7e95ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a517f7-6917-4df5-b330-73e9bf85c873', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d913ec7b-9800-4dbf-8140-6a4579d4943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:13 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd Jul 05 18:43:13 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:13 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume volume-19a517f7-6917-4df5-b330-73e9bf85c873 (19a517f7-6917-4df5-b330-73e9bf85c873): created successfully Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d913ec7b-9800-4dbf-8140-6a4579d4943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:13 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (f8c9ae89-6554-4c97-9150-3ae5f9f1cebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-50b3f84a-0f5f-46b6-b065-ca0100519838 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created volume successfully. Jul 05 18:43:14 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422" returned: 0 in 0.867s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:14 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd" returned: 0 in 0.889s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3f20c679-eeec-414e-a7ea-f594d57d34f0_1i39fwbydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:43:14 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Converted 0.00 MB image at 0.00 MB/s Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:14 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 Jul 05 18:43:14 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:14 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd 1G Jul 05 18:43:14 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:14 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa 1073741824" returned: 0 in 0.964s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:14 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa Jul 05 18:43:14 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:14 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd 1G" returned: 0 in 0.731s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:14 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422" returned: 1 in 0.902s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Downloaded image f0375f3b-5898-45a9-959d-e55a05b494ac ((None, [{'url': 'file:///opt/stack/data/glance/images/f0375f3b-5898-45a9-959d-e55a05b494ac', 'metadata': {}}])) to volume ce881f65-2c03-47e9-922f-bd750f6b8422 successfully. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Temporary image f0375f3b-5898-45a9-959d-e55a05b494ac for user 23a8466083ac4941a263a51706c1cf24 is deleted. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Marking volume ce881f65-2c03-47e9-922f-bd750f6b8422 as bootable. {{(pid=86664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Copying metadata from image f0375f3b-5898-45a9-959d-e55a05b494ac to ce881f65-2c03-47e9-922f-bd750f6b8422. {{(pid=86664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Creating volume glance metadata for volume ce881f65-2c03-47e9-922f-bd750f6b8422 backed by image f0375f3b-5898-45a9-959d-e55a05b494ac with: {'image_id': 'f0375f3b-5898-45a9-959d-e55a05b494ac', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2486e8da41c8e16c1f64aa63133ec810', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e78a73-416d-44a4-8abf-61981ed640d5]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:14 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa" returned: 0 in 0.722s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.038s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1110239676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c14f37f-6390-4080-9e2d-8ded17e72782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:04Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Creating volume 0c14f37f-6390-4080-9e2d-8ded17e72782 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:15 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad7939d-2bd3-48d4-adef-3d57c5e58570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed52e7bb-207f-4dc0-be84-987973efddaa', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c1951d-3412-4b36-95f7-68b76643012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:15 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782 1073741824 Jul 05 18:43:15 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:15 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume volume-ed52e7bb-207f-4dc0-be84-987973efddaa (ed52e7bb-207f-4dc0-be84-987973efddaa): created successfully Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c1951d-3412-4b36-95f7-68b76643012e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (3559b895-0aa0-440e-a2ba-aa4d596c60ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:15 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-48f98bea-d246-435c-8d37-dab9573f7081 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created volume successfully. Jul 05 18:43:15 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd Jul 05 18:43:15 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0407050-54dc-44d8-8c7d-6bd2524eace2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce881f65-2c03-47e9-922f-bd750f6b8422', 'volume_size': 1, 'image_id': 'f0375f3b-5898-45a9-959d-e55a05b494ac', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f0375f3b-5898-45a9-959d-e55a05b494ac', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2486e8da41c8e16c1f64aa63133ec810', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0184b320e68b4b26b7c9437c11aeb178', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ca2a0b0a553d39593042635834acd85643ff02050302697dcbc1cf06f454ed3298b60336ccc191705f505149b5767be6879396f2a4856e2dbeb78b7996e965c', 'id': 'f0375f3b-5898-45a9-959d-e55a05b494ac', 'created_at': datetime.datetime(2026, 7, 5, 16, 42, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 42, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f0375f3b-5898-45a9-959d-e55a05b494ac/file', 'properties': {}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e463adc-6241-43e9-aed8-15ffecc6eb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:15 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Volume volume-ce881f65-2c03-47e9-922f-bd750f6b8422 (ce881f65-2c03-47e9-922f-bd750f6b8422): created successfully Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e463adc-6241-43e9-aed8-15ffecc6eb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Flow 'volume_create_manager' (40c7471a-50e3-43b4-8bee-0bb1407fd08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:15 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-81f5cc74-114f-4452-8505-7173a2a023dc tempest-VolumeImageDependencyTests-1152397444 None] Created volume successfully. Jul 05 18:43:15 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd" returned: 0 in 0.985s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:16 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782 1073741824" returned: 0 in 1.032s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:16 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd Jul 05 18:43:16 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:16 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782 Jul 05 18:43:16 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Acquiring lock "cinder-ce881f65-2c03-47e9-922f-bd750f6b8422-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Lock "cinder-ce881f65-2c03-47e9-922f-bd750f6b8422-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Acquiring lock "cinder-quobyte-ce881f65-2c03-47e9-922f-bd750f6b8422" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Lock "cinder-quobyte-ce881f65-2c03-47e9-922f-bd750f6b8422" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adc0ffe-8d0a-4486-a22d-cf5fcede74f0]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:16 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 Jul 05 18:43:16 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:16 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:16 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd" returned: 1 in 0.905s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Downloaded image 3f20c679-eeec-414e-a7ea-f594d57d34f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/3f20c679-eeec-414e-a7ea-f594d57d34f0', 'metadata': {}}])) to volume a48d98a9-7fc0-4965-9908-ae89fecdcebd successfully. {{(pid=86664) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Temporary image 3f20c679-eeec-414e-a7ea-f594d57d34f0 for user 012ecddb422d4152b1df1bca51158f9b is deleted. {{(pid=86664) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.volume_utils [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Marking volume a48d98a9-7fc0-4965-9908-ae89fecdcebd as bootable. {{(pid=86664) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782" returned: 0 in 0.793s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.506s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1855172481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e586b6-2a47-4187-92c8-4fc5139bcb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470f245476a149bc9a1362b09578d3e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:04Z,use_quota=True,user_id='a795358dbd454b3bae3dde49618183d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Creating volume 83e586b6-2a47-4187-92c8-4fc5139bcb57 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:16 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Copying metadata from image 3f20c679-eeec-414e-a7ea-f594d57d34f0 to a48d98a9-7fc0-4965-9908-ae89fecdcebd. {{(pid=86664) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Creating volume glance metadata for volume a48d98a9-7fc0-4965-9908-ae89fecdcebd backed by image 3f20c679-eeec-414e-a7ea-f594d57d34f0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3f20c679-eeec-414e-a7ea-f594d57d34f0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bc4e910fe57b62ead297399bef880c7e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86664) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98008388-5491-4357-a26f-ab55a5d5bd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c14f37f-6390-4080-9e2d-8ded17e72782', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:16 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 1073741824 Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbfbc7b-2a2c-4bc2-9158-10877d67c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:16 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:16 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume volume-0c14f37f-6390-4080-9e2d-8ded17e72782 (0c14f37f-6390-4080-9e2d-8ded17e72782): created successfully Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbfbc7b-2a2c-4bc2-9158-10877d67c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (5690afe6-77f5-4ca4-9429-a07f9a710cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c108cf7f-1f99-4363-b6b6-7b9ea2c2a6b3 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created volume successfully. Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb1d606-34e2-4def-9d52-7cf880d6cc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd', 'volume_size': 1, 'image_id': '3f20c679-eeec-414e-a7ea-f594d57d34f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3f20c679-eeec-414e-a7ea-f594d57d34f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc4e910fe57b62ead297399bef880c7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '070d5384025a495f9f5bc1ae9f66bb3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3427decc012df5cae4f6f41a983b1ad12a8f8f384bf1bdfa667c1d44b1ee2dc437131850245f9ce8c9cdfb1bc36fe033cabf8cabb33e5403c046c1a93dd20033', 'id': '3f20c679-eeec-414e-a7ea-f594d57d34f0', 'created_at': datetime.datetime(2026, 7, 5, 16, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 5, 16, 42, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3f20c679-eeec-414e-a7ea-f594d57d34f0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f6caca-3069-48b0-a8ed-02ab44140196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:17 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Volume volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd (a48d98a9-7fc0-4965-9908-ae89fecdcebd): created successfully Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f6caca-3069-48b0-a8ed-02ab44140196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Flow 'volume_create_manager' (e3aa8850-efdc-4c86-ad3a-084bec942b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2a096580-1885-4304-944f-a0714dc0a470 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Created volume successfully. Jul 05 18:43:17 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422" returned: 0 in 0.805s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:17 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 Jul 05 18:43:17 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Acquiring lock "cinder-a48d98a9-7fc0-4965-9908-ae89fecdcebd-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "cinder-a48d98a9-7fc0-4965-9908-ae89fecdcebd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Acquiring lock "cinder-quobyte-a48d98a9-7fc0-4965-9908-ae89fecdcebd" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "cinder-quobyte-a48d98a9-7fc0-4965-9908-ae89fecdcebd" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[11278966-2e75-494e-8dac-d48a82338be3]: (4, 'raw') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:17 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd Jul 05 18:43:17 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:17 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 1073741824" returned: 0 in 1.086s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:18 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 Jul 05 18:43:18 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:18 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422" returned: 1 in 1.020s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:18 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422 Jul 05 18:43:18 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:18 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd" returned: 0 in 0.976s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:18 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd Jul 05 18:43:18 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:18 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57" returned: 0 in 0.774s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.018s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Acquiring lock "cinder-quobyte-d6381eda-414b-4048-85df-203c355d90fe-64a43eff-e7b8-4351-8e27-492b9cd98762" by "_create_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685ae959-6226-46df-9161-7ab16e427373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e586b6-2a47-4187-92c8-4fc5139bcb57', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca7a567-ad05-45aa-86c4-86c028416b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-d6381eda-414b-4048-85df-203c355d90fe-64a43eff-e7b8-4351-8e27-492b9cd98762" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Creating volume 64a43eff-e7b8-4351-8e27-492b9cd98762 from snapshot d6381eda-414b-4048-85df-203c355d90fe {{(pid=86664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Acquiring lock "cinder-quobyte-64a43eff-e7b8-4351-8e27-492b9cd98762" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:18 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Volume volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 (83e586b6-2a47-4187-92c8-4fc5139bcb57): created successfully Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca7a567-ad05-45aa-86c4-86c028416b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Flow 'volume_create_manager' (eb704ee3-b241-4a7d-978e-9f0c2cc59816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-64a43eff-e7b8-4351-8e27-492b9cd98762" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] snapshot: d6381eda-414b-4048-85df-203c355d90fe, volume: 64a43eff-e7b8-4351-8e27-492b9cd98762, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:43:18 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-bfa2e4bc-f824-4d14-9cd5-7e33732f8ac5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created volume successfully. Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b7b17f-8ee5-4e2b-a6f1-735fd902c7ee]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:19 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ce881f65-2c03-47e9-922f-bd750f6b8422" returned: 0 in 0.791s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:19 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe Jul 05 18:43:19 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Lock "cinder-quobyte-ce881f65-2c03-47e9-922f-bd750f6b8422" released by "delete_volume" :: held 2.708s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Created reservations ['64e2b6a7-8419-4031-80aa-6b17bfef1596', '728d6919-62d0-481f-bfa1-1d8bde811487', 'f2de31b2-ab8d-4a89-8f8e-15996efb5f33', '13755f9f-d885-4dbd-a84b-7670fbc277d2'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:19 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:19 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:19 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd" returned: 1 in 0.888s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd' failed. Not Retrying. {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:19 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd Jul 05 18:43:19 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:19 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe" returned: 0 in 0.967s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14a59adc-de06-42e2-ac2d-0f05d8111176(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e609555-819b-4da0-ac48-0c3484fd9d4f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-83e586b6-2a47-4187-92c8-4fc5139bcb57-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-83e586b6-2a47-4187-92c8-4fc5139bcb57-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-quobyte-83e586b6-2a47-4187-92c8-4fc5139bcb57" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-83e586b6-2a47-4187-92c8-4fc5139bcb57" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:20 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.922s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:20 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 Jul 05 18:43:20 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Deleted volume successfully. Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[64634140-762e-4b57-b99f-e533bcf2763d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcbd9d46-dbd8-457d-9b86-ae89b392a6a6 tempest-VolumeImageDependencyTests-1152397444 None] Lock "cinder-ce881f65-2c03-47e9-922f-bd750f6b8422-delete_volume" released by "delete_volume" :: held 3.913s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:20 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 Jul 05 18:43:20 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:20 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a48d98a9-7fc0-4965-9908-ae89fecdcebd" returned: 0 in 0.962s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "cinder-quobyte-a48d98a9-7fc0-4965-9908-ae89fecdcebd" released by "delete_volume" :: held 2.913s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Created reservations ['5c7e5bda-aaf4-420a-91a4-cd8eb73b149c', 'f5304616-5668-4eac-9aa6-5f31320fbedf', 'ffe216ed-8d24-40c0-9858-fad081de5c83', 'f0e5075a-cca2-47bc-8208-1d1ad7005bd0'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:20 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:20 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:21 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176" returned: 0 in 1.348s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:21 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:43:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:21 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 Jul 05 18:43:21 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:21 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.001s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:21 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:21 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Deleted volume successfully. Jul 05 18:43:21 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4b4685ae-b2aa-4564-8ad9-0c3a4c01b852 tempest-VolumeAndVolumeTypeFromImageTest-1576887205 None] Lock "cinder-a48d98a9-7fc0-4965-9908-ae89fecdcebd-delete_volume" released by "delete_volume" :: held 4.237s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:21 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57" returned: 0 in 1.497s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:21 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57 Jul 05 18:43:21 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:23 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-83e586b6-2a47-4187-92c8-4fc5139bcb57" returned: 0 in 1.355s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-83e586b6-2a47-4187-92c8-4fc5139bcb57" released by "delete_volume" :: held 2.963s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:23 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Created reservations ['8dd9dbff-ad95-4516-b58f-30ac9c725592', '392d99a7-bec8-4645-bb66-a3709ea78f74', 'abf42f7f-63f8-4904-befd-5984bebe0021', 'ae4d86b5-c71e-4ebe-a2dd-e8d4917bfb50'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:23 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:23 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:23 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-0c14f37f-6390-4080-9e2d-8ded17e72782-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-0c14f37f-6390-4080-9e2d-8ded17e72782-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-quobyte-0c14f37f-6390-4080-9e2d-8ded17e72782" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-0c14f37f-6390-4080-9e2d-8ded17e72782" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a597d89c-f3a4-405e-b92a-4e9443425026]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:25 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782 Jul 05 18:43:25 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:25 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.817s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:25 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:25 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Deleted volume successfully. Jul 05 18:43:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e069db7-5264-49af-8bbf-5924139fd82a tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-83e586b6-2a47-4187-92c8-4fc5139bcb57-delete_volume" released by "delete_volume" :: held 5.511s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:27 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782" returned: 0 in 2.062s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:27 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782 Jul 05 18:43:27 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Flow 'volume_create_manager' (b98dc55f-c080-4405-816d-979d3c925abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a576e210-9219-4a37-981f-a98736cdc4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a576e210-9219-4a37-981f-a98736cdc4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b815f6da-60ad-4589-87c5-0a71b5f1ec35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8013dd500c1e4ce5847aec7a81bc0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:28Z,use_quota=True,user_id='17aaa95d4db94988aa200a1f874eb379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c4808e-fac3-4708-8824-2178dfb8b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c4808e-fac3-4708-8824-2178dfb8b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b621e2-3ea1-433e-bcc0-2737ef1469da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b621e2-3ea1-433e-bcc0-2737ef1469da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b815f6da-60ad-4589-87c5-0a71b5f1ec35', 'volume_name': 'volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce775ef6-c4b9-494a-a350-cdd7dc0f20ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce775ef6-c4b9-494a-a350-cdd7dc0f20ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863741a8-b9fc-4a6d-a940-01cba2f7f74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:28 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Volume b815f6da-60ad-4589-87c5-0a71b5f1ec35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35', 'volume_size': 1} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:28 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0c14f37f-6390-4080-9e2d-8ded17e72782" returned: 0 in 1.464s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-0c14f37f-6390-4080-9e2d-8ded17e72782" released by "delete_volume" :: held 3.666s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created reservations ['3a6bc7b2-af4b-4595-8941-22b1d67db8ee', 'b2f29592-bec6-4751-9391-c604116cd3f4', '6107afd7-8581-4332-b792-85b94b58dfd0', '8e635287-e3c6-45e7-85df-0949cfd8307d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:28 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762" returned: 0 in 7.613s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57a0928-741d-4848-b90f-cc2152879702]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:29 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:29 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:29 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 Jul 05 18:43:29 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:29 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.757s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Deleted volume successfully. Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1dff00dc-303b-4256-ba98-3676020d39d7 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-0c14f37f-6390-4080-9e2d-8ded17e72782-delete_volume" released by "delete_volume" :: held 4.823s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-ed52e7bb-207f-4dc0-be84-987973efddaa-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-ed52e7bb-207f-4dc0-be84-987973efddaa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-quobyte-ed52e7bb-207f-4dc0-be84-987973efddaa" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-ed52e7bb-207f-4dc0-be84-987973efddaa" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e359b18-b01b-4870-9afe-048b9cd48818]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:29 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176" returned: 0 in 1.050s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:43:30 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Converted 1024.00 MB image at 134.48 MB/s Jul 05 18:43:30 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 is being set with open permissions: ugo+rw Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:30 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 Jul 05 18:43:30 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:30 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa Jul 05 18:43:30 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:30 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762" returned: 0 in 0.747s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-64a43eff-e7b8-4351-8e27-492b9cd98762" released by "_copy_volume_from_snapshot" :: held 11.870s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-d6381eda-414b-4048-85df-203c355d90fe-64a43eff-e7b8-4351-8e27-492b9cd98762" released by "_create_volume_from_snapshot" :: held 11.939s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.994s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.224s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b815f6da-60ad-4589-87c5-0a71b5f1ec35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8013dd500c1e4ce5847aec7a81bc0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:28Z,use_quota=True,user_id='17aaa95d4db94988aa200a1f874eb379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Creating volume b815f6da-60ad-4589-87c5-0a71b5f1ec35 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:30 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:30 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa" returned: 0 in 0.900s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:30 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 1073741824 Jul 05 18:43:30 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109893a3-eeed-4114-a5bd-16341c0d0285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a43eff-e7b8-4351-8e27-492b9cd98762', 'volume_size': 1, 'snapshot_id': 'd6381eda-414b-4048-85df-203c355d90fe'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:30 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa Jul 05 18:43:30 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d219b57e-3481-4d8a-86f6-e2c95b87d361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:30 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Volume volume-64a43eff-e7b8-4351-8e27-492b9cd98762 (64a43eff-e7b8-4351-8e27-492b9cd98762): created successfully Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d219b57e-3481-4d8a-86f6-e2c95b87d361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Flow 'volume_create_manager' (b767853c-3dd5-49ef-a0fd-5a24872fa00d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (affe74d0-40f4-4d48-a6ce-4d48bb2446ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8a33ea-f5b9-48c9-9485-ab925ad2eb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-21cd8a95-f424-4a23-b0b3-6810a48ccc5e tempest-VolumeDependencyTests-805716433 None] Created volume successfully. Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8a33ea-f5b9-48c9-9485-ab925ad2eb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930759808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795c2b38-8bef-4c8a-b7b1-7c69767ecc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:31Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d1587d-87a3-4971-8550-07f20ad87916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d1587d-87a3-4971-8550-07f20ad87916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373a8506-c1a2-4613-8be6-2af6ac84404e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373a8506-c1a2-4613-8be6-2af6ac84404e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795c2b38-8bef-4c8a-b7b1-7c69767ecc60', 'volume_name': 'volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864525ad-08a3-4115-a6b2-090336c3f6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864525ad-08a3-4115-a6b2-090336c3f6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af541240-bb62-4c84-991e-7e9176d47afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Volume 795c2b38-8bef-4c8a-b7b1-7c69767ecc60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60', 'volume_size': 1} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Acquiring lock "cinder-d6381eda-414b-4048-85df-203c355d90fe-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-d6381eda-414b-4048-85df-203c355d90fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Acquiring lock "cinder-quobyte-14a59adc-de06-42e2-ac2d-0f05d8111176" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-14a59adc-de06-42e2-ac2d-0f05d8111176" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Acquiring lock "cinder-quobyte-d6381eda-414b-4048-85df-203c355d90fe" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-d6381eda-414b-4048-85df-203c355d90fe" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Deleting offline snapshot d6381eda-414b-4048-85df-203c355d90fe of volume 14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] snapshot_file for this snap is: volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cef1601-7241-485e-bba0-0976da640a07]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (8824ca70-6dc3-4418-9447-e9490e563348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b364c156-c876-4667-86cd-c3de94c4d157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b364c156-c876-4667-86cd-c3de94c4d157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-584483559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:32Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b655bdb-2106-4b65-94b2-d97cd3747896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b655bdb-2106-4b65-94b2-d97cd3747896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8b3ed5-88a2-47af-af7a-87e6272c464b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8b3ed5-88a2-47af-af7a-87e6272c464b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac', 'volume_name': 'volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fed47ba-1045-4374-9c21-9918cf269d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fed47ba-1045-4374-9c21-9918cf269d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123828f5-9ed1-4ff6-9e3c-4014214380b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:31 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Volume bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac', 'volume_size': 1} Jul 05 18:43:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:31 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe Jul 05 18:43:31 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:32 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ed52e7bb-207f-4dc0-be84-987973efddaa" returned: 0 in 1.213s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-ed52e7bb-207f-4dc0-be84-987973efddaa" released by "delete_volume" :: held 2.169s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (ea0bdff4-7bae-4929-a038-75e215a59a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f91359-2d8f-414d-ad1d-5d0a0daabd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created reservations ['2b26f2b4-3496-42f4-b184-ecd41bac4db4', '72f7e2b5-fb80-443b-ac47-3bd16077ddb9', '098bfd42-3431-40af-b624-f278d37c13df', 'a5dd23bc-f6e8-47af-8443-965ab906c99e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:32 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f91359-2d8f-414d-ad1d-5d0a0daabd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249932766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5e7f60-9b5a-48ac-a8c2-993cdccaaf38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:32Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123a44b9-4139-4cbb-8ba3-581fcbf5be2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (123a44b9-4139-4cbb-8ba3-581fcbf5be2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40bedae-569e-41a6-97f6-972283669dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40bedae-569e-41a6-97f6-972283669dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5e7f60-9b5a-48ac-a8c2-993cdccaaf38', 'volume_name': 'volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d389f3da-bdcf-4411-ac23-7ab0355fc8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d389f3da-bdcf-4411-ac23-7ab0355fc8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0192bd22-f84d-4747-924e-c8630a7d5888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:32 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Volume af5e7f60-9b5a-48ac-a8c2-993cdccaaf38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38', 'volume_size': 1} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 1073741824" returned: 0 in 1.469s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:32 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 Jul 05 18:43:32 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:32 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:32 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:32 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe" returned: 0 in 1.177s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14a59adc-de06-42e2-ac2d-0f05d8111176(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cf8834-cff3-4eee-907b-3223ba540814]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:32 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 Jul 05 18:43:32 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (4d98a0e3-cf7e-48e8-b0bf-a94eb877a559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f445e4b7-fbb5-4778-b61f-e77cbf53f45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f445e4b7-fbb5-4778-b61f-e77cbf53f45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105121357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e732d45a-a1e3-40f9-8c7a-2ca099a1ff02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:33Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0bd5bb-7c65-4174-ba57-4e8219105287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0bd5bb-7c65-4174-ba57-4e8219105287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e2531a-0699-4594-84fe-39b3ec27a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e2531a-0699-4594-84fe-39b3ec27a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e732d45a-a1e3-40f9-8c7a-2ca099a1ff02', 'volume_name': 'volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3af639c-eded-458b-8cf2-f97078fd1b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3af639c-eded-458b-8cf2-f97078fd1b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a216725-dfce-44f1-b1c3-28cfe9da4750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Volume e732d45a-a1e3-40f9-8c7a-2ca099a1ff02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02', 'volume_size': 1} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:33 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (f7d4550f-1d78-48ac-a1f7-fdbffd1e63ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4326943a-9b53-49d8-a701-e0ae8c24523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.882s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4326943a-9b53-49d8-a701-e0ae8c24523a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1993895555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9513f0-7168-4633-8c7b-f3a654638880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:33Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfaf7a3-fc44-4a03-8838-e675cfcc5633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfaf7a3-fc44-4a03-8838-e675cfcc5633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1f712f-91e1-4fa0-b577-d34338e93f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1f712f-91e1-4fa0-b577-d34338e93f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9513f0-7168-4633-8c7b-f3a654638880', 'volume_name': 'volume-2b9513f0-7168-4633-8c7b-f3a654638880', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5abb59-2ffc-4ef9-911a-c6d7b72f581c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5abb59-2ffc-4ef9-911a-c6d7b72f581c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e83270-46f8-40d1-8ac9-fc6ef8777e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Volume 2b9513f0-7168-4633-8c7b-f3a654638880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9513f0-7168-4633-8c7b-f3a654638880', 'volume_size': 1} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Deleted volume successfully. Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-19a517f7-6917-4df5-b330-73e9bf85c873-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-19a517f7-6917-4df5-b330-73e9bf85c873-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f1efc647-e0e8-4568-97b8-e81318f51861 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-ed52e7bb-207f-4dc0-be84-987973efddaa-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-quobyte-19a517f7-6917-4df5-b330-73e9bf85c873" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-19a517f7-6917-4df5-b330-73e9bf85c873" acquired by "delete_volume" :: waited 0.013s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b86104-da94-490f-b011-efa8a4cc5b38]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:33 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35" returned: 0 in 1.136s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] <== create_volume: return (2694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.699s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.325s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930759808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795c2b38-8bef-4c8a-b7b1-7c69767ecc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:31Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Creating volume 795c2b38-8bef-4c8a-b7b1-7c69767ecc60 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:33 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:33 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 1073741824 Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863741a8-b9fc-4a6d-a940-01cba2f7f74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f78ec7-7424-40de-ae67-b6419d474acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Volume volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 (b815f6da-60ad-4589-87c5-0a71b5f1ec35): created successfully Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f78ec7-7424-40de-ae67-b6419d474acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Flow 'volume_create_manager' (b98dc55f-c080-4405-816d-979d3c925abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-577c94e9-758e-4e17-9a9a-ef9f63d6cfc8 tempest-CinderUnicodeTest-1158081994 None] Created volume successfully. Jul 05 18:43:33 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873 Jul 05 18:43:33 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:33 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176" returned: 0 in 1.091s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:33 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe Jul 05 18:43:33 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:34 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873" returned: 0 in 0.913s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:34 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873 Jul 05 18:43:34 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:34 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 1073741824" returned: 0 in 0.933s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:34 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 Jul 05 18:43:34 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:34 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe" returned: 0 in 0.953s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:34 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe Jul 05 18:43:34 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:35 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-19a517f7-6917-4df5-b330-73e9bf85c873" returned: 0 in 0.877s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-19a517f7-6917-4df5-b330-73e9bf85c873" released by "delete_volume" :: held 1.848s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:35 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60" returned: 0 in 0.855s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.661s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-584483559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:32Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Creating volume bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:35 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:35 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac 1073741824 Jul 05 18:43:35 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af541240-bb62-4c84-991e-7e9176d47afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f97cc7f-8320-46ec-9761-fd71820f94d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created reservations ['6f278651-9ac3-4fb3-be58-8fd58c72ee7b', 'b1e490a2-c25c-40c3-9e10-475ea04c4b07', 'e45ed3a9-6a5f-4d4d-9938-dfcf7fe3ee25', 'dbffad05-bb4b-4e38-823c-d4e3f7e5f3a7'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Volume volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 (795c2b38-8bef-4c8a-b7b1-7c69767ecc60): created successfully Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f97cc7f-8320-46ec-9761-fd71820f94d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (affe74d0-40f4-4d48-a6ce-4d48bb2446ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Flow 'volume_create_manager' (3d42ec9c-2fc0-4620-b48a-7fbe61dc53ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3dfbe5-f10a-4a0d-8a02-d013caf3edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a48d97de-3a87-427d-b3a0-5253370e82bb tempest-CreateVolumesFromImageTest-507289217 None] Created volume successfully. Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3dfbe5-f10a-4a0d-8a02-d013caf3edae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-197259259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd88922e-94e4-4a22-9e3f-3ed6678646e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8013dd500c1e4ce5847aec7a81bc0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:35Z,use_quota=True,user_id='17aaa95d4db94988aa200a1f874eb379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8509ee2-f848-425b-8a69-c728e6f5e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8509ee2-f848-425b-8a69-c728e6f5e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfd9f56-fc56-49dd-bc90-efa3cb3b9c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfd9f56-fc56-49dd-bc90-efa3cb3b9c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd88922e-94e4-4a22-9e3f-3ed6678646e0', 'volume_name': 'volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ec1651-016a-4cda-b67a-006745314916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ec1651-016a-4cda-b67a-006745314916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3f258d-35f3-4960-bb2d-256e7d0ed86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Volume dd88922e-94e4-4a22-9e3f-3ed6678646e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0', 'volume_size': 1} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:35 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176.d6381eda-414b-4048-85df-203c355d90fe" returned: 0 in 0.815s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-d5299273-7667-4b38-a742-d5f91a0e1cec-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-d6381eda-414b-4048-85df-203c355d90fe" released by "_delete_snapshot" :: held 4.225s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-d5299273-7667-4b38-a742-d5f91a0e1cec-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-14a59adc-de06-42e2-ac2d-0f05d8111176" released by "delete_snapshot" :: held 4.291s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:35 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:35 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-quobyte-d5299273-7667-4b38-a742-d5f91a0e1cec" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-d5299273-7667-4b38-a742-d5f91a0e1cec" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[996549e6-4bb3-4877-8f9d-a26ab559ae22]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:35 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Created reservations ['9ffa68b2-cd10-47f2-8766-4bfeded98d69', '405f31c7-bb27-4fea-a619-b1112ee49f3f', '658b4f92-64fe-4a54-a5ca-87508e8cf972', 'd43224cf-e0db-4bc4-a54c-74b742300437'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Delete snapshot completed successfully. Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fa1c3aac-2fad-4d33-b422-0d71b098ff0e tempest-VolumeDependencyTests-805716433 None] Lock "cinder-d6381eda-414b-4048-85df-203c355d90fe-delete_snapshot" released by "delete_snapshot" :: held 4.548s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:36 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec Jul 05 18:43:36 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:36 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac 1073741824" returned: 0 in 0.982s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:36 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac Jul 05 18:43:36 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:36 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.789s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:36 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Deleted volume successfully. Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-29105281-c6b9-4409-8c23-365d8d28ec64 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-19a517f7-6917-4df5-b330-73e9bf85c873-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:36 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec" returned: 0 in 0.868s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:36 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec Jul 05 18:43:36 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Acquiring lock "cinder-14a59adc-de06-42e2-ac2d-0f05d8111176-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Lock "cinder-14a59adc-de06-42e2-ac2d-0f05d8111176-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Acquiring lock "cinder-quobyte-14a59adc-de06-42e2-ac2d-0f05d8111176" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-14a59adc-de06-42e2-ac2d-0f05d8111176" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[209c16e7-a891-4ee4-bae2-3f03c29e9206]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:37 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 Jul 05 18:43:37 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:37 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac" returned: 0 in 0.801s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.931s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-249932766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5e7f60-9b5a-48ac-a8c2-993cdccaaf38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:32Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Creating volume af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:37 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:37 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 1073741824 Jul 05 18:43:37 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123828f5-9ed1-4ff6-9e3c-4014214380b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1066e43d-2eed-466c-a516-98b1fc82156b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:37 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Volume volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac (bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac): created successfully Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1066e43d-2eed-466c-a516-98b1fc82156b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (8824ca70-6dc3-4418-9447-e9490e563348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ccdee054-1f81-4201-a71a-fe3bb8def586 tempest-CreateVolumesFromImageTest-507289217 None] Created volume successfully. Jul 05 18:43:37 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d5299273-7667-4b38-a742-d5f91a0e1cec" returned: 0 in 0.823s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-d5299273-7667-4b38-a742-d5f91a0e1cec" released by "delete_volume" :: held 1.756s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created reservations ['c8f8fee5-a192-489d-9f63-aae141190f33', 'e9d37ab6-3f8c-40c9-b62e-af8c17b3fad7', '9b77e534-a8c8-45ac-86e6-1ab0aa91ff22', '65d7fe2f-2836-4228-9941-3c1e1d1f40b6'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:37 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:37 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:37 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176" returned: 0 in 1.008s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:37 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176 Jul 05 18:43:37 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-2cf089cd-6095-4b7b-a25d-95df4a18de55-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-2cf089cd-6095-4b7b-a25d-95df4a18de55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-quobyte-5461bfed-15d6-48ec-b5d6-62f6e651ad14" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-5461bfed-15d6-48ec-b5d6-62f6e651ad14" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-quobyte-2cf089cd-6095-4b7b-a25d-95df4a18de55" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-2cf089cd-6095-4b7b-a25d-95df4a18de55" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Deleting offline snapshot 2cf089cd-6095-4b7b-a25d-95df4a18de55 of volume 5461bfed-15d6-48ec-b5d6-62f6e651ad14 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] snapshot_file for this snap is: volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee03e5ba-318e-4f3f-a877-3c44f79699dd]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:38 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 Jul 05 18:43:38 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:38 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 1073741824" returned: 0 in 1.166s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:38 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 Jul 05 18:43:38 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:38 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.838s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:38 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Deleted volume successfully. Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4de5d556-082c-467c-a281-7986c0c32fe5 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-d5299273-7667-4b38-a742-d5f91a0e1cec-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:38 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-14a59adc-de06-42e2-ac2d-0f05d8111176" returned: 0 in 0.860s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-14a59adc-de06-42e2-ac2d-0f05d8111176" released by "delete_volume" :: held 1.956s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Created reservations ['1f25b44f-9f07-4d18-83ba-cc569cea0334', 'ea5601a4-8922-47f4-a7eb-c822fc7162ed', 'c2b462d1-a3d4-439e-b2f3-3a2dc2374c5f', '51f76209-306c-49da-90eb-6c1897482083'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:39 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:39 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Acquiring lock "cinder-64a43eff-e7b8-4351-8e27-492b9cd98762-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Lock "cinder-64a43eff-e7b8-4351-8e27-492b9cd98762-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Acquiring lock "cinder-quobyte-64a43eff-e7b8-4351-8e27-492b9cd98762" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:39 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-64a43eff-e7b8-4351-8e27-492b9cd98762" acquired by "delete_volume" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55" returned: 0 in 1.137s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[32909e22-c6b8-4069-8223-d096a82ef36f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee42f46-301c-4303-bde4-c8ec299c9964]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:39 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38" returned: 0 in 0.872s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.191s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105121357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e732d45a-a1e3-40f9-8c7a-2ca099a1ff02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:33Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Creating volume e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:39 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0192bd22-f84d-4747-924e-c8630a7d5888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2d57e9-4200-4062-a6db-300734c85780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:39 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 1073741824 Jul 05 18:43:39 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:39 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Volume volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 (af5e7f60-9b5a-48ac-a8c2-993cdccaaf38): created successfully Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2d57e9-4200-4062-a6db-300734c85780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (ea0bdff4-7bae-4929-a038-75e215a59a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:39 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 Jul 05 18:43:39 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e5b8178a-0c10-4f24-ba11-fd48bb77ab56 tempest-CreateVolumesFromImageTest-507289217 None] Created volume successfully. Jul 05 18:43:39 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 Jul 05 18:43:39 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:39 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.931s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Deleted volume successfully. Jul 05 18:43:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-ac23231d-8068-4c8a-b6db-3fd98a4e01d0 tempest-VolumeDependencyTests-805716433 None] Lock "cinder-14a59adc-de06-42e2-ac2d-0f05d8111176-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:40 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14" returned: 0 in 1.056s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:40 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 1073741824" returned: 0 in 1.008s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:40 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 Jul 05 18:43:40 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:40 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762" returned: 0 in 1.125s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:40 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762 Jul 05 18:43:40 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:40 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 Jul 05 18:43:40 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:41 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02" returned: 0 in 0.668s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.765s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1993895555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9513f0-7168-4633-8c7b-f3a654638880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c4ee0c50d4275940ad62744adeefa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:33Z,use_quota=True,user_id='00e803caa020483b8aedb2adb1c7ab63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Creating volume 2b9513f0-7168-4633-8c7b-f3a654638880 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:41 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:41 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880 1073741824 Jul 05 18:43:41 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a216725-dfce-44f1-b1c3-28cfe9da4750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:41 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bac12bb-be94-4ade-b04c-3655d14afe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-64a43eff-e7b8-4351-8e27-492b9cd98762" returned: 0 in 0.765s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Lock "cinder-quobyte-64a43eff-e7b8-4351-8e27-492b9cd98762" released by "delete_volume" :: held 1.965s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:41 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Volume volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 (e732d45a-a1e3-40f9-8c7a-2ca099a1ff02): created successfully Jul 05 18:43:41 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bac12bb-be94-4ade-b04c-3655d14afe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (4d98a0e3-cf7e-48e8-b0bf-a94eb877a559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55" returned: 0 in 0.878s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-00cf5f16-ea3f-4317-a121-2e51422f5469 tempest-CreateVolumesFromImageTest-507289217 None] Created volume successfully. Jul 05 18:43:41 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55 Jul 05 18:43:41 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Created reservations ['3943195a-c7cc-45cf-9813-7994d4b46ee5', 'f952fef8-61c8-45d0-8ef4-fc8d9837eaed', 'd0ef4f2d-8386-4c43-9c1f-de596bb6e643', '8e20b457-ceae-419d-b336-3e5755aa9531'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:41 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:41 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:42 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14.2cf089cd-6095-4b7b-a25d-95df4a18de55" returned: 0 in 0.776s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-2cf089cd-6095-4b7b-a25d-95df4a18de55" released by "_delete_snapshot" :: held 3.985s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:42 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880 1073741824" returned: 0 in 0.958s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-5461bfed-15d6-48ec-b5d6-62f6e651ad14" released by "delete_snapshot" :: held 4.017s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:42 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.742s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:42 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880 Jul 05 18:43:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Deleted volume successfully. Jul 05 18:43:42 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created reservations ['bc846a00-4d89-469f-8491-c2162a184f33', '3a52621d-8883-4331-a762-a3c71c0f9b54', '707a4fd3-2369-43a9-8c0e-ed949faa491a', 'a4fa517e-1903-4ed7-a53c-57f8834716aa'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3342f23a-6ad7-495f-8f8a-f4b8352c8baa tempest-VolumeDependencyTests-805716433 None] Lock "cinder-64a43eff-e7b8-4351-8e27-492b9cd98762-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Delete snapshot completed successfully. Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8c82d042-7ed1-4a80-b36a-67fe57940508 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-2cf089cd-6095-4b7b-a25d-95df4a18de55-delete_snapshot" released by "delete_snapshot" :: held 4.240s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:42 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880" returned: 0 in 0.718s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.251s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-197259259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd88922e-94e4-4a22-9e3f-3ed6678646e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8013dd500c1e4ce5847aec7a81bc0882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:35Z,use_quota=True,user_id='17aaa95d4db94988aa200a1f874eb379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Creating volume dd88922e-94e4-4a22-9e3f-3ed6678646e0 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:42 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73e83270-46f8-40d1-8ac9-fc6ef8777e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9513f0-7168-4633-8c7b-f3a654638880', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:42 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 1073741824 Jul 05 18:43:42 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff56cc6d-89c0-4829-8f90-892c52ac67e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:42 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Volume volume-2b9513f0-7168-4633-8c7b-f3a654638880 (2b9513f0-7168-4633-8c7b-f3a654638880): created successfully Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff56cc6d-89c0-4829-8f90-892c52ac67e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Flow 'volume_create_manager' (f7d4550f-1d78-48ac-a1f7-fdbffd1e63ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b560a56f-7efd-43ba-b35a-b9422b53d47a tempest-CreateVolumesFromImageTest-507289217 None] Created volume successfully. Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-2b9513f0-7168-4633-8c7b-f3a654638880-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-5461bfed-15d6-48ec-b5d6-62f6e651ad14-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-5461bfed-15d6-48ec-b5d6-62f6e651ad14-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-2b9513f0-7168-4633-8c7b-f3a654638880-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "cinder-quobyte-5461bfed-15d6-48ec-b5d6-62f6e651ad14" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-quobyte-2b9513f0-7168-4633-8c7b-f3a654638880" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-5461bfed-15d6-48ec-b5d6-62f6e651ad14" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-2b9513f0-7168-4633-8c7b-f3a654638880" acquired by "delete_volume" :: waited 0.048s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf7071d-0561-4af7-8b28-13e086f15e74]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[7166847c-0a93-41db-ac3c-de8bd8739169]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:43 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 Jul 05 18:43:43 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:43 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880 Jul 05 18:43:43 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:44 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 1073741824" returned: 0 in 1.146s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:44 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 Jul 05 18:43:44 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:44 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880" returned: 0 in 1.046s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:44 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14" returned: 0 in 1.084s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:44 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880 Jul 05 18:43:44 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:44 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14 Jul 05 18:43:44 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:45 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0" returned: 0 in 0.956s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] <== create_volume: return (2204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=115,cinder:UPDATE=144,cinder:DELETE=13,cinder:INSERT=34 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3f258d-35f3-4960-bb2d-256e7d0ed86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f7314f-17cb-4364-9880-2b20c5a1487f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:45 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Volume volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 (dd88922e-94e4-4a22-9e3f-3ed6678646e0): created successfully Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f7314f-17cb-4364-9880-2b20c5a1487f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Flow 'volume_create_manager' (3d42ec9c-2fc0-4620-b48a-7fbe61dc53ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a2e524d6-5c23-44ef-a667-7c39c476d8c3 tempest-CinderUnicodeTest-1158081994 None] Created volume successfully. Jul 05 18:43:45 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5461bfed-15d6-48ec-b5d6-62f6e651ad14" returned: 0 in 0.694s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-quobyte-5461bfed-15d6-48ec-b5d6-62f6e651ad14" released by "delete_volume" :: held 1.863s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=137,cinder:SELECT=109,cinder:INSERT=47,cinder:DELETE=14 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:43:45 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2b9513f0-7168-4633-8c7b-f3a654638880" returned: 0 in 0.803s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Created reservations ['518bd850-2dd1-4a63-9a1d-fa0447863aee', '8b65b614-671c-4bcb-b961-a5054a316c77', '265d662f-ac69-4dc4-93e8-8f3dccd20c59', 'ed7dbe25-9f59-4c51-b910-b11e184b97a8'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-2b9513f0-7168-4633-8c7b-f3a654638880" released by "delete_volume" :: held 1.920s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:45 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:45 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Created reservations ['4097592e-8981-434f-8581-0aa77a2c00eb', 'ad09b0f6-786c-4865-a10e-eb51f0320583', 'daea11c9-8425-4b37-af76-c7b8a1732422', '1ac584f5-42c0-400b-b009-b7018a814c49'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:45 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:45 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Creating offline snapshot 220ad653-fc4d-4874-a058-92da1e1c07cf of volume dd88922e-94e4-4a22-9e3f-3ed6678646e0 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[da00ae8f-e509-4353-b28b-671a45be977e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:46 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.015s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:46 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Deleted volume successfully. Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1e8a2f0d-418f-4b8c-98d1-4caaf5c913b6 tempest-CreateVolumesFromSnapshotTest-527062530 None] Lock "cinder-5461bfed-15d6-48ec-b5d6-62f6e651ad14-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:46 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 Jul 05 18:43:46 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:46 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.099s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:46 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Deleted volume successfully. Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7dc2550e-c6f2-4d00-a0ca-4d719e60b249 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-2b9513f0-7168-4633-8c7b-f3a654638880-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:46 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-quobyte-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02" acquired by "delete_volume" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:47 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9cdedb-954a-4d83-8b93-230c8367b4b3]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:47 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 Jul 05 18:43:47 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-161ad6d3-4dec-483c-b144-7d23433a4d1b tempest-ProjectAdminTests-1340617080 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7357330322266, 'free_capacity_gb': 1775.7357330322266, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86664) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 05 18:43:47 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0" returned: 0 in 1.134s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:47 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf 1G Jul 05 18:43:47 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:47 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02" returned: 0 in 0.945s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:48 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02 Jul 05 18:43:48 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:48 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf 1G" returned: 0 in 1.024s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:48 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf Jul 05 18:43:48 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:48 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02" returned: 0 in 0.855s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02" released by "delete_volume" :: held 1.854s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:48 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Created reservations ['b7155c76-e01b-4ef3-aa98-3841015f43bb', 'b4a1c72b-83fc-43aa-9b4e-178e7654517b', '644863da-5ee2-48f7-8947-054a0cdc1ed9', '69054b9e-7c5f-4562-9b4e-74dbbd38f2fd'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:49 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:49 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-quobyte-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38" acquired by "delete_volume" :: waited 0.036s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a4624a-e9f0-4557-9e28-05cc5e457cfe]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:49 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 Jul 05 18:43:49 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:49 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf" returned: 0 in 1.134s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:49 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf is being set with open permissions: ugo+rw Jul 05 18:43:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:49 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf Jul 05 18:43:49 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (bb3e2567-9fd0-4263-8124-34decdcb18a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48af37e4-12c0-4ad3-9ac3-b9a2409c1b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48af37e4-12c0-4ad3-9ac3-b9a2409c1b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2022171128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2883c815-21a1-47a9-833b-faee73a94a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:50Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959c8cf8-cb47-419e-91d1-bab09a5cb4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:50 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (959c8cf8-cb47-419e-91d1-bab09a5cb4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc161fc0-89da-4891-9b90-a4b7765eabcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc161fc0-89da-4891-9b90-a4b7765eabcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2883c815-21a1-47a9-833b-faee73a94a17', 'volume_name': 'volume-2883c815-21a1-47a9-833b-faee73a94a17', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95de39c3-c3ab-4489-94c4-454b25ab98dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95de39c3-c3ab-4489-94c4-454b25ab98dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0190d9ec-2d90-4151-85b1-adebb72bbc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:50 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume 2883c815-21a1-47a9-833b-faee73a94a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2883c815-21a1-47a9-833b-faee73a94a17', 'volume_size': 1} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.126s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:50 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Deleted volume successfully. Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-82736bfb-8ad3-477a-9134-55e0910a2800 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-e732d45a-a1e3-40f9-8c7a-2ca099a1ff02-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:50 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38" returned: 0 in 1.237s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:50 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38 Jul 05 18:43:50 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:50 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf" returned: 0 in 0.978s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:50 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.info Jul 05 18:43:50 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:51 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38" returned: 0 in 0.766s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38" released by "delete_volume" :: held 2.093s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:51 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.info" returned: 0 in 0.736s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:51 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.info is being set with open permissions: ugo+rw Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Created reservations ['6c0a6c98-f846-4b59-a9d6-710c478e06aa', 'a319e85d-cd7a-47bd-95e0-f0cfa4ba1fd8', 'e442bbe7-cfcb-4d31-8e09-b00fc93c5cbb', '0cc4bf7f-2293-4602-9891-3238b40239d7'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:51 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.info Jul 05 18:43:51 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:51 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:51 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:52 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.info" returned: 0 in 0.806s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.949s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.239s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2022171128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2883c815-21a1-47a9-833b-faee73a94a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:50Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Creating volume 2883c815-21a1-47a9-833b-faee73a94a17 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:52 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:52 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17 1073741824 Jul 05 18:43:52 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:52 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-226b89cb-c120-46c4-8e53-03808f24ea94 tempest-CinderUnicodeTest-1158081994 None] Create snapshot completed successfully Jul 05 18:43:52 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.826s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:52 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Deleted volume successfully. Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25515dd3-2343-4864-8c6b-8202afdaafc3 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-af5e7f60-9b5a-48ac-a8c2-993cdccaaf38-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-quobyte-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "cinder-220ad653-fc4d-4874-a058-92da1e1c07cf-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[91732520-9d15-4efa-a946-008cc40d0b74]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-220ad653-fc4d-4874-a058-92da1e1c07cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "cinder-quobyte-dd88922e-94e4-4a22-9e3f-3ed6678646e0" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-quobyte-dd88922e-94e4-4a22-9e3f-3ed6678646e0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "cinder-quobyte-220ad653-fc4d-4874-a058-92da1e1c07cf" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-quobyte-220ad653-fc4d-4874-a058-92da1e1c07cf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Deleting offline snapshot 220ad653-fc4d-4874-a058-92da1e1c07cf of volume dd88922e-94e4-4a22-9e3f-3ed6678646e0 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] snapshot_file for this snap is: volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0819d6f3-3d39-4fa9-b1f9-1ea263e5085c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:53 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac Jul 05 18:43:53 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:53 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf Jul 05 18:43:53 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:53 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17 1073741824" returned: 0 in 1.088s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:53 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17 Jul 05 18:43:53 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:53 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac" returned: 0 in 0.971s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:53 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac Jul 05 18:43:53 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:54 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf" returned: 0 in 0.991s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f34b52-7723-4a08-a3b5-fe8e9a876ca7]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:54 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 Jul 05 18:43:54 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:54 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17" returned: 0 in 0.869s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0190d9ec-2d90-4151-85b1-adebb72bbc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2883c815-21a1-47a9-833b-faee73a94a17', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e7304f-70f9-4acf-ad69-7a36aa9c6350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:54 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume volume-2883c815-21a1-47a9-833b-faee73a94a17 (2883c815-21a1-47a9-833b-faee73a94a17): created successfully Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6e7304f-70f9-4acf-ad69-7a36aa9c6350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (bb3e2567-9fd0-4263-8124-34decdcb18a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-93b0a850-0a8a-45dc-8cff-125fff5152b6 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created volume successfully. Jul 05 18:43:54 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac" returned: 0 in 0.802s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac" released by "delete_volume" :: held 1.846s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Created reservations ['f5dbc41e-77a7-4894-9bfe-3ae5224ee0cf', '569e67be-3ec5-478d-a7fe-7eb5265402f0', '9e8d54c9-865d-4343-b0a2-12050f825b68', '8cb2b454-a997-4995-ade1-265bc4917976'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:54 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:54 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-795c2b38-8bef-4c8a-b7b1-7c69767ecc60-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-795c2b38-8bef-4c8a-b7b1-7c69767ecc60-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:55 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "cinder-quobyte-795c2b38-8bef-4c8a-b7b1-7c69767ecc60" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0" returned: 0 in 1.106s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-795c2b38-8bef-4c8a-b7b1-7c69767ecc60" acquired by "delete_volume" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:55 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf Jul 05 18:43:55 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b57b72-db08-44eb-a8b1-64748783e68b]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:55 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 Jul 05 18:43:55 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:55 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.918s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:55 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Deleted volume successfully. Jul 05 18:43:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2e88137f-4e32-4970-95af-64ca144d3472 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-bb7cf954-8690-4b8b-9cd4-d9c8da74e6ac-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (8ba174cf-6c89-4b14-b7df-97aee2e31311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508bed8e-0ea8-41bd-89b6-76f9512859e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508bed8e-0ea8-41bd-89b6-76f9512859e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700660166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46b25b5-0a2d-4c13-920e-b3811a0fe0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:56Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce678e7-4a38-4f8a-a2a5-a242e258f04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce678e7-4a38-4f8a-a2a5-a242e258f04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04c91c7-4f5f-4cbe-907a-c2be36d54764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04c91c7-4f5f-4cbe-907a-c2be36d54764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b46b25b5-0a2d-4c13-920e-b3811a0fe0a2', 'volume_name': 'volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a438e-1caf-4f7f-8e8e-3431075f0fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a438e-1caf-4f7f-8e8e-3431075f0fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6321c0bb-808e-439d-87a7-b16847262e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:56 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume b46b25b5-0a2d-4c13-920e-b3811a0fe0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2', 'volume_size': 1} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700660166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b46b25b5-0a2d-4c13-920e-b3811a0fe0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:56Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Creating volume b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:56 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:56 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 1073741824 Jul 05 18:43:56 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:56 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf" returned: 0 in 1.684s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:57 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:57 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (9dcd2626-d9e0-4429-8f73-cc64ee108e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68838d0c-a7b0-4980-b0ba-81d1c75ca699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60" returned: 0 in 1.738s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68838d0c-a7b0-4980-b0ba-81d1c75ca699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295037536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0e83ca-d459-467a-a9aa-fc2acd963b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:57Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa09822-97d8-4f88-927a-962eb578dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa09822-97d8-4f88-927a-962eb578dda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8818817d-b6ef-498b-9165-7e7ec0007064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60 Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8818817d-b6ef-498b-9165-7e7ec0007064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0e83ca-d459-467a-a9aa-fc2acd963b8a', 'volume_name': 'volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:57 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d5dad-3c38-4090-a836-d719f728c9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940d5dad-3c38-4090-a836-d719f728c9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b691e0a0-35fb-412e-b2c5-966e801203d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume 2e0e83ca-d459-467a-a9aa-fc2acd963b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a', 'volume_size': 1} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (faef9a3d-a903-4d80-976b-0781b798702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4518df-2047-43fb-8ab6-caf9706dc11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4518df-2047-43fb-8ab6-caf9706dc11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1431750766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918b55b0-2f22-4ca0-b554-5d28fa07611d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:58Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c189915-9300-4281-a17c-cfbf88b91f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c189915-9300-4281-a17c-cfbf88b91f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357d1308-0764-4bd7-8c89-fca6e288c2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357d1308-0764-4bd7-8c89-fca6e288c2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918b55b0-2f22-4ca0-b554-5d28fa07611d', 'volume_name': 'volume-918b55b0-2f22-4ca0-b554-5d28fa07611d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d05d78-1295-4f8f-ae7f-9067b89916c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d05d78-1295-4f8f-ae7f-9067b89916c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cdcad3-cb24-4167-99ad-fd0cb68e1d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:57 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume 918b55b0-2f22-4ca0-b554-5d28fa07611d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918b55b0-2f22-4ca0-b554-5d28fa07611d', 'volume_size': 1} Jul 05 18:43:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:58 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 1073741824" returned: 0 in 1.705s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:58 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0.220ad653-fc4d-4874-a058-92da1e1c07cf" returned: 0 in 1.330s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:58 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 Jul 05 18:43:58 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-quobyte-220ad653-fc4d-4874-a058-92da1e1c07cf" released by "_delete_snapshot" :: held 5.314s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-quobyte-dd88922e-94e4-4a22-9e3f-3ed6678646e0" released by "delete_snapshot" :: held 5.345s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (1478afc4-d5f8-40a7-bcef-d81e52a80230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:58 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1e95cb-81f3-4b40-949f-07f32df74bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-795c2b38-8bef-4c8a-b7b1-7c69767ecc60" returned: 0 in 1.354s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1e95cb-81f3-4b40-949f-07f32df74bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1999201746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d9fd72-b465-4d2a-b947-4b084dddeb3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:58Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ff44eb-3cba-447a-8c70-1c15e390750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ff44eb-3cba-447a-8c70-1c15e390750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36091026-8e3c-4072-9efb-a56226d346c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36091026-8e3c-4072-9efb-a56226d346c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d9fd72-b465-4d2a-b947-4b084dddeb3e', 'volume_name': 'volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8a700c-81bd-4e89-a1fd-65a28b38fb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8a700c-81bd-4e89-a1fd-65a28b38fb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49505f7-a94a-4070-a8fc-3e42f355003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume 80d9fd72-b465-4d2a-b947-4b084dddeb3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e', 'volume_size': 1} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-quobyte-795c2b38-8bef-4c8a-b7b1-7c69767ecc60" released by "delete_volume" :: held 3.259s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Created reservations ['240ef707-3c51-49fa-9e81-779258ae34d4', 'f378c89d-afbc-4dc9-87a3-95d1fa167568', '370acf53-2b42-43bb-a5cc-bfefdec55728', 'f1298fb9-2283-46b3-b270-a799fc2b12e3'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Created reservations ['2dcc108e-b8c4-4f01-9f7a-3b7582c8144c', 'c716b566-0c01-4e96-a294-e8a0e0c003ca', '050031fd-62fb-44b6-b14d-a3a1addb548f', '55cb840a-f46c-4664-aac8-d5ceee47c27a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:43:58 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Delete snapshot completed successfully. Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-2bda6465-4650-41b4-9485-9a86cb9f0544 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-220ad653-fc4d-4874-a058-92da1e1c07cf-delete_snapshot" released by "delete_snapshot" :: held 5.713s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:58 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:43:58 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (da2bf728-5d44-4095-abfb-7ece984b3b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e737b4b4-c0c5-445e-8a0b-ef12dcf2083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e737b4b4-c0c5-445e-8a0b-ef12dcf2083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-623859946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e70a9d0-6028-4598-b787-b791015b4791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:59Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ae26ad-579b-4959-8f8f-1e222299d413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ae26ad-579b-4959-8f8f-1e222299d413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cc62ca-514b-4e05-a20b-790426d9f620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32cc62ca-514b-4e05-a20b-790426d9f620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e70a9d0-6028-4598-b787-b791015b4791', 'volume_name': 'volume-0e70a9d0-6028-4598-b787-b791015b4791', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38cc3bc-09e2-4df2-928d-08dbe23e35eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38cc3bc-09e2-4df2-928d-08dbe23e35eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0df0a48-bec0-4351-b65f-e8a2c0a042c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:59 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume 0e70a9d0-6028-4598-b787-b791015b4791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e70a9d0-6028-4598-b787-b791015b4791', 'volume_size': 1} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:59 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2" returned: 0 in 1.038s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] <== create_volume: return (2848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.857s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.115s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295037536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0e83ca-d459-467a-a9aa-fc2acd963b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:57Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Creating volume 2e0e83ca-d459-467a-a9aa-fc2acd963b8a {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:43:59 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:59 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a 1073741824 Jul 05 18:43:59 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6321c0bb-808e-439d-87a7-b16847262e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe8ae36-981e-4d64-82c0-1976d7746dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:43:59 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 (b46b25b5-0a2d-4c13-920e-b3811a0fe0a2): created successfully Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe8ae36-981e-4d64-82c0-1976d7746dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (8ba174cf-6c89-4b14-b7df-97aee2e31311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:43:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0e5ead69-c3c7-4f68-8cd9-248cf74494f3 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created volume successfully. Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "cinder-dd88922e-94e4-4a22-9e3f-3ed6678646e0-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-dd88922e-94e4-4a22-9e3f-3ed6678646e0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "cinder-quobyte-dd88922e-94e4-4a22-9e3f-3ed6678646e0" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-quobyte-dd88922e-94e4-4a22-9e3f-3ed6678646e0" acquired by "delete_volume" :: waited 0.026s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:43:59 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.934s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:43:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Deleted volume successfully. Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e16c31-1974-46e6-ac22-3e56ac7ada85]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:43:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-80b67e29-217f-4d28-8c4a-51e3794b0de6 tempest-CreateVolumesFromImageTest-507289217 None] Lock "cinder-795c2b38-8bef-4c8a-b7b1-7c69767ecc60-delete_volume" released by "delete_volume" :: held 4.584s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:43:59 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 Jul 05 18:43:59 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:00 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a 1073741824" returned: 0 in 1.377s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:00 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a Jul 05 18:44:00 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:00 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0" returned: 0 in 1.088s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:00 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0 Jul 05 18:44:00 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:01 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a" returned: 0 in 0.869s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.628s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1431750766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918b55b0-2f22-4ca0-b554-5d28fa07611d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:58Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Creating volume 918b55b0-2f22-4ca0-b554-5d28fa07611d {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:01 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:01 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d 1073741824 Jul 05 18:44:01 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b691e0a0-35fb-412e-b2c5-966e801203d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a6a2fc-8830-4617-a954-3dbdd5b3f13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:01 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a (2e0e83ca-d459-467a-a9aa-fc2acd963b8a): created successfully Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a6a2fc-8830-4617-a954-3dbdd5b3f13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (9dcd2626-d9e0-4429-8f73-cc64ee108e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-750e4876-2fb2-4c82-bda5-0c6b54ea0e36 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created volume successfully. Jul 05 18:44:01 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-dd88922e-94e4-4a22-9e3f-3ed6678646e0" returned: 0 in 1.030s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-quobyte-dd88922e-94e4-4a22-9e3f-3ed6678646e0" released by "delete_volume" :: held 2.217s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:02 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Created reservations ['451a7a86-0b6b-4944-b587-2f5e2ca94135', '46275106-2888-4afd-a5fe-1ceb060d0f0f', '9c484246-d521-40a0-b815-7ec816f137ed', 'ad3b07b1-61ba-4d8a-a7be-eb7879d20eeb'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:02 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:02 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:02 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:02 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d 1073741824" returned: 0 in 1.191s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:02 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d Jul 05 18:44:02 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "cinder-b815f6da-60ad-4589-87c5-0a71b5f1ec35-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-b815f6da-60ad-4589-87c5-0a71b5f1ec35-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "cinder-quobyte-b815f6da-60ad-4589-87c5-0a71b5f1ec35" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-quobyte-b815f6da-60ad-4589-87c5-0a71b5f1ec35" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ebaba4-e709-4a40-b2f8-52ac22db000d]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:03 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.217s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:03 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Deleted volume successfully. Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-75d473bf-f9ed-48da-a10c-2f28a5862b46 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-dd88922e-94e4-4a22-9e3f-3ed6678646e0-delete_volume" released by "delete_volume" :: held 3.891s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:03 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 Jul 05 18:44:03 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:03 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d" returned: 0 in 1.106s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:44:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.435s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1999201746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d9fd72-b465-4d2a-b947-4b084dddeb3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:58Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Creating volume 80d9fd72-b465-4d2a-b947-4b084dddeb3e {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:04 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cdcad3-cb24-4167-99ad-fd0cb68e1d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918b55b0-2f22-4ca0-b554-5d28fa07611d', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0648fb-589d-463b-ace1-6320849ae3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:04 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e 1073741824 Jul 05 18:44:04 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume volume-918b55b0-2f22-4ca0-b554-5d28fa07611d (918b55b0-2f22-4ca0-b554-5d28fa07611d): created successfully Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0648fb-589d-463b-ace1-6320849ae3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (faef9a3d-a903-4d80-976b-0781b798702d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7c2d5038-35c9-4ab3-b018-42dc6dddd252 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created volume successfully. Jul 05 18:44:04 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35" returned: 0 in 1.205s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:04 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35 Jul 05 18:44:04 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:05 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e 1073741824" returned: 0 in 1.268s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:05 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e Jul 05 18:44:05 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:05 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b815f6da-60ad-4589-87c5-0a71b5f1ec35" returned: 0 in 1.148s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-quobyte-b815f6da-60ad-4589-87c5-0a71b5f1ec35" released by "delete_volume" :: held 2.421s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Created reservations ['6844abe8-8942-4001-a54a-649f239ccb8c', 'c35ec2ef-2b93-4518-9a6b-6f74d3e3e611', '4204239b-1016-4fd7-8174-b994b343c67c', '83361762-ff20-4c59-ac5f-e4b445552ae7'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:05 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:05 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:06 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e" returned: 0 in 0.902s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.060s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-623859946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e70a9d0-6028-4598-b787-b791015b4791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fa8ac10216e44afaf1b5056ce8876ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:43:59Z,use_quota=True,user_id='b2931c371d9e4869ba72d6ede1ee7f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Creating volume 0e70a9d0-6028-4598-b787-b791015b4791 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:06 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49505f7-a94a-4070-a8fc-3e42f355003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:06 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791 1073741824 Jul 05 18:44:06 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339c05f8-d792-4f4b-9ead-3b4f1dabdf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:06 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e (80d9fd72-b465-4d2a-b947-4b084dddeb3e): created successfully Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339c05f8-d792-4f4b-9ead-3b4f1dabdf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:06 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (1478afc4-d5f8-40a7-bcef-d81e52a80230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:06 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1a6def63-b4d2-4874-9bea-4a35b41d624a tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created volume successfully. Jul 05 18:44:07 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.217s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:07 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Deleted volume successfully. Jul 05 18:44:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-221b2a1b-8dac-4967-b9f0-73c13cdb22a7 tempest-CinderUnicodeTest-1158081994 None] Lock "cinder-b815f6da-60ad-4589-87c5-0a71b5f1ec35-delete_volume" released by "delete_volume" :: held 3.974s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:07 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791 1073741824" returned: 0 in 1.703s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:08 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791 Jul 05 18:44:08 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:08 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791" returned: 0 in 0.869s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] <== create_volume: return (2673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:44:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.678s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0df0a48-bec0-4351-b65f-e8a2c0a042c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e70a9d0-6028-4598-b787-b791015b4791', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a1c86c-8ff8-4955-912f-504cb32dd453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:08 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Volume volume-0e70a9d0-6028-4598-b787-b791015b4791 (0e70a9d0-6028-4598-b787-b791015b4791): created successfully Jul 05 18:44:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a1c86c-8ff8-4955-912f-504cb32dd453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:08 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Flow 'volume_create_manager' (da2bf728-5d44-4095-abfb-7ece984b3b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:08 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-195d5b8b-75d8-4112-86c1-74613fc32d91 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created volume successfully. Jul 05 18:44:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-0e70a9d0-6028-4598-b787-b791015b4791-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-0e70a9d0-6028-4598-b787-b791015b4791-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-quobyte-0e70a9d0-6028-4598-b787-b791015b4791" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-0e70a9d0-6028-4598-b787-b791015b4791" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:09 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2a06b7-b077-4e6f-8f6c-4a18f5451f27]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:09 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791 Jul 05 18:44:09 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:10 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791" returned: 0 in 1.141s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:10 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791 Jul 05 18:44:10 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:11 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0e70a9d0-6028-4598-b787-b791015b4791" returned: 0 in 1.036s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:11 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-0e70a9d0-6028-4598-b787-b791015b4791" released by "delete_volume" :: held 2.232s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:11 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created reservations ['a96a7873-8283-4d79-9c97-15e56473e09e', 'b6056b52-984a-4a94-ba18-2c294b85c572', '51f85c04-3630-4ce7-b93a-c2992b3d95bd', 'a2894f84-352f-49b0-a9a9-0cb03bff544f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:12 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:12 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:12 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:12 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:12 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.794s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:44:12 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.902s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:12 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Deleted volume successfully. Jul 05 18:44:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-80d9fd72-b465-4d2a-b947-4b084dddeb3e-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-8b85ea73-a6ac-45ff-88a4-025ffc3748c4 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-0e70a9d0-6028-4598-b787-b791015b4791-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-80d9fd72-b465-4d2a-b947-4b084dddeb3e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-quobyte-80d9fd72-b465-4d2a-b947-4b084dddeb3e" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-80d9fd72-b465-4d2a-b947-4b084dddeb3e" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:13 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b4acff-ca90-4416-954c-74cd40ba836f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:13 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e Jul 05 18:44:13 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:14 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e" returned: 0 in 1.021s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:14 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e Jul 05 18:44:14 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (582c7d91-955f-4d89-99e0-c3fc2c8d834f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c96ec4-5bd8-4846-91e9-489db1a9080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c96ec4-5bd8-4846-91e9-489db1a9080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1539342913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065edeb0-a2ec-4da0-9c27-867ab073cb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:15Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e5ede3-83b4-424e-a953-68be23cd108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e5ede3-83b4-424e-a953-68be23cd108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9df791-6d22-43ad-8116-267876cb506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9df791-6d22-43ad-8116-267876cb506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065edeb0-a2ec-4da0-9c27-867ab073cb56', 'volume_name': 'volume-065edeb0-a2ec-4da0-9c27-867ab073cb56', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcae69fb-76a6-4bca-b2f6-bd09d779132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcae69fb-76a6-4bca-b2f6-bd09d779132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d140aaa-fd98-4997-84e6-301d1a3ec6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:14 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Volume 065edeb0-a2ec-4da0-9c27-867ab073cb56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065edeb0-a2ec-4da0-9c27-867ab073cb56', 'volume_size': 1} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1539342913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065edeb0-a2ec-4da0-9c27-867ab073cb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:15Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Creating volume 065edeb0-a2ec-4da0-9c27-867ab073cb56 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:14 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:44:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:14 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 1073741824 Jul 05 18:44:14 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:15 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-80d9fd72-b465-4d2a-b947-4b084dddeb3e" returned: 0 in 0.942s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:15 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-80d9fd72-b465-4d2a-b947-4b084dddeb3e" released by "delete_volume" :: held 2.050s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:15 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created reservations ['082a7801-f5dd-4b82-8378-2120d7ae8a91', 'd0fff4ca-4554-46ad-8ef4-38c1d828cb39', 'd92a41fd-42b5-4002-a4d8-9e8af5561f07', '8e9a6996-b8e5-4108-86f7-cb33bdf4931c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:15 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:15 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:16 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 1073741824" returned: 0 in 1.244s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:16 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 Jul 05 18:44:16 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:16 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.955s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Deleted volume successfully. Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5c46c933-bf48-42f1-a85b-c827429d0369 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-80d9fd72-b465-4d2a-b947-4b084dddeb3e-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-918b55b0-2f22-4ca0-b554-5d28fa07611d-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-918b55b0-2f22-4ca0-b554-5d28fa07611d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-quobyte-918b55b0-2f22-4ca0-b554-5d28fa07611d" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-918b55b0-2f22-4ca0-b554-5d28fa07611d" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa9913c-d242-469e-9a61-7bbdccb0ac0a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:16 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d Jul 05 18:44:16 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:17 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56" returned: 0 in 0.966s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:44:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.285s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d140aaa-fd98-4997-84e6-301d1a3ec6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065edeb0-a2ec-4da0-9c27-867ab073cb56', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816c5365-40e8-403a-9733-fdb47b809677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:17 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Volume volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 (065edeb0-a2ec-4da0-9c27-867ab073cb56): created successfully Jul 05 18:44:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816c5365-40e8-403a-9733-fdb47b809677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (582c7d91-955f-4d89-99e0-c3fc2c8d834f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:17 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d5f8e547-7069-460c-9f97-6d534d185644 tempest-ProjectReaderTests-1750246745 None] Created volume successfully. Jul 05 18:44:17 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d" returned: 0 in 0.940s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:17 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d Jul 05 18:44:17 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Creating offline snapshot 3e62264d-1783-43c6-a916-4b4aa100c860 of volume 065edeb0-a2ec-4da0-9c27-867ab073cb56 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:44:18 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0cdafa-5a52-499c-b93d-aa9fd6617875]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:18 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 Jul 05 18:44:18 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:18 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-918b55b0-2f22-4ca0-b554-5d28fa07611d" returned: 0 in 1.114s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-918b55b0-2f22-4ca0-b554-5d28fa07611d" released by "delete_volume" :: held 2.131s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:18 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created reservations ['9817f3d7-5930-4801-b0bf-b5a521cdf802', '648d513d-8bc6-4c43-b305-c47db30c30d2', 'fa265a17-dc8b-4481-8698-7e4133357a70', '18208886-72a7-4728-8259-9afc17a989a7'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:19 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:19 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:19 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56" returned: 0 in 0.945s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:19 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 1G Jul 05 18:44:19 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:19 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.727s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:19 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Deleted volume successfully. Jul 05 18:44:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-fcee59a6-c074-4dc1-b38a-fe50a70f9ad5 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-918b55b0-2f22-4ca0-b554-5d28fa07611d-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-2e0e83ca-d459-467a-a9aa-fc2acd963b8a-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-2e0e83ca-d459-467a-a9aa-fc2acd963b8a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-quobyte-2e0e83ca-d459-467a-a9aa-fc2acd963b8a" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-2e0e83ca-d459-467a-a9aa-fc2acd963b8a" acquired by "delete_volume" :: waited 0.049s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:20 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9c11e9-2d33-433b-92a1-d919c1735a65]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:20 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a Jul 05 18:44:20 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:20 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 1G" returned: 0 in 1.256s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:20 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 Jul 05 18:44:20 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:21 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:21 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a" returned: 0 in 1.232s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860" returned: 0 in 1.002s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:21 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 is being set with open permissions: ugo+rw Jul 05 18:44:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:21 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a Jul 05 18:44:21 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:21 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 Jul 05 18:44:21 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:22 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860" returned: 0 in 0.830s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:22 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.info Jul 05 18:44:22 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:22 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2e0e83ca-d459-467a-a9aa-fc2acd963b8a" returned: 0 in 1.029s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-2e0e83ca-d459-467a-a9aa-fc2acd963b8a" released by "delete_volume" :: held 2.341s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created reservations ['ee2b8861-4792-4952-8ffb-a8747ad25f71', '0ed6d84f-e43e-4b43-ab0b-2e48da791fd9', 'ba77bad1-70a0-48a0-bf9e-efb0ed227740', '27c45119-b55d-4087-a256-6bb4964fd8db'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:22 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:22 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:23 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.info" returned: 0 in 0.913s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:23 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.info is being set with open permissions: ugo+rw Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:23 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.info Jul 05 18:44:23 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:23 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.012s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:23 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Deleted volume successfully. Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-quobyte-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-21bc4a1c-b5e9-4d29-ac28-d7bd23183704 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-2e0e83ca-d459-467a-a9aa-fc2acd963b8a-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2" acquired by "delete_volume" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5ed5a3-e54b-446f-a067-ff8b1f773984]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:24 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 Jul 05 18:44:24 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:24 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.info" returned: 0 in 1.025s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.134s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:24 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4dd422ea-44a5-4ab2-9e98-8f2094781a5e tempest-ProjectReaderTests-1750246745 None] Create snapshot completed successfully Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-3e62264d-1783-43c6-a916-4b4aa100c860-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:25 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2" returned: 0 in 1.216s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-3e62264d-1783-43c6-a916-4b4aa100c860-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-065edeb0-a2ec-4da0-9c27-867ab073cb56" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:25 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2 Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-065edeb0-a2ec-4da0-9c27-867ab073cb56" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-3e62264d-1783-43c6-a916-4b4aa100c860" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:25 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-3e62264d-1783-43c6-a916-4b4aa100c860" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Deleting offline snapshot 3e62264d-1783-43c6-a916-4b4aa100c860 of volume 065edeb0-a2ec-4da0-9c27-867ab073cb56 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] snapshot_file for this snap is: volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[877861ad-38fd-4ca2-be39-9b238813e990]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:25 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 Jul 05 18:44:25 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:26 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2" returned: 0 in 1.160s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2" released by "delete_volume" :: held 2.469s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created reservations ['95272508-55ce-41d5-99f0-e7d15c91739c', '4cf90ce3-a001-4bc0-b40c-edf6f458dc2e', '6c73dd89-a2d7-4336-8dc4-6660a189315c', '3170fccf-76fa-4a11-8583-b4a37d3c903f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:26 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:26 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:26 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860" returned: 0 in 1.377s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-065edeb0-a2ec-4da0-9c27-867ab073cb56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[480fb8f2-2eb2-485e-8775-f1f43b6ff579]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Flow 'volume_create_manager' (cfe29268-bfa4-44f0-b4ea-f4a0c39a5168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415716f1-c59e-4e64-b792-d66c3f381e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415716f1-c59e-4e64-b792-d66c3f381e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-241336207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff73c9c4-de49-49ad-a4da-e46032c5e960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cb15e8c06946958ece5f44d47fd14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:27Z,use_quota=True,user_id='9f4c9ba1ce0f4831b7f7877a0a56a824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa77810-9484-468b-af32-0191c4a93473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa77810-9484-468b-af32-0191c4a93473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5944d727-6751-4c3f-a369-b7c8f620ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5944d727-6751-4c3f-a369-b7c8f620ea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff73c9c4-de49-49ad-a4da-e46032c5e960', 'volume_name': 'volume-ff73c9c4-de49-49ad-a4da-e46032c5e960', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdb8a41-099d-4e49-a814-4034d2d19ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdb8a41-099d-4e49-a814-4034d2d19ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3b7bc3-2880-44ab-9a08-35af14282325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:27 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Volume ff73c9c4-de49-49ad-a4da-e46032c5e960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff73c9c4-de49-49ad-a4da-e46032c5e960', 'volume_size': 1} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-241336207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff73c9c4-de49-49ad-a4da-e46032c5e960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cb15e8c06946958ece5f44d47fd14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:27Z,use_quota=True,user_id='9f4c9ba1ce0f4831b7f7877a0a56a824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Creating volume ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:27 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:27 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 Jul 05 18:44:27 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:27 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 1073741824 Jul 05 18:44:27 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-2883c815-21a1-47a9-833b-faee73a94a17-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-2883c815-21a1-47a9-833b-faee73a94a17-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "cinder-quobyte-2883c815-21a1-47a9-833b-faee73a94a17" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-2883c815-21a1-47a9-833b-faee73a94a17" acquired by "delete_volume" :: waited 0.045s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbcce19-9b70-4161-9742-de99f29cc6ca]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:27 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.162s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Deleted volume successfully. Jul 05 18:44:27 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17 Jul 05 18:44:27 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-abd5f00b-c510-4cd8-8740-91b7c2202af7 tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-b46b25b5-0a2d-4c13-920e-b3811a0fe0a2-delete_volume" released by "delete_volume" :: held 4.133s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:28 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56" returned: 0 in 1.205s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:28 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 Jul 05 18:44:28 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:28 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 1073741824" returned: 0 in 1.468s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:28 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 Jul 05 18:44:28 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:28 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17" returned: 0 in 1.059s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:28 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17 Jul 05 18:44:28 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:28 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860" returned: 0 in 0.980s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:29 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860 Jul 05 18:44:29 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:29 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960" returned: 0 in 0.802s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] <== create_volume: return (2339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3b7bc3-2880-44ab-9a08-35af14282325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff73c9c4-de49-49ad-a4da-e46032c5e960', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb292cc-bca5-454e-996c-8b1981f95a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:29 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Volume volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 (ff73c9c4-de49-49ad-a4da-e46032c5e960): created successfully Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb292cc-bca5-454e-996c-8b1981f95a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Flow 'volume_create_manager' (cfe29268-bfa4-44f0-b4ea-f4a0c39a5168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f83a6384-2a1a-4a9c-a76a-d5af43a82761 tempest-SnapshotDependencyTests-517002990 None] Created volume successfully. Jul 05 18:44:29 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2883c815-21a1-47a9-833b-faee73a94a17" returned: 0 in 0.872s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-quobyte-2883c815-21a1-47a9-833b-faee73a94a17" released by "delete_volume" :: held 2.010s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Created reservations ['5059af83-f355-459b-9931-289379038c21', '1e57deea-97b6-43a5-8ace-7421e5bcc712', '41432685-028e-4a79-b5f3-4b4ed12e5451', '15f99d08-5a71-4407-ae4f-531ada615e95'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:29 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56.3e62264d-1783-43c6-a916-4b4aa100c860" returned: 0 in 0.789s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:29 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:29 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-3e62264d-1783-43c6-a916-4b4aa100c860" released by "_delete_snapshot" :: held 4.578s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-065edeb0-a2ec-4da0-9c27-867ab073cb56" released by "delete_snapshot" :: held 4.618s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Created reservations ['e36be795-36e2-4523-a29f-8fef91412671', '6f62e5b2-743f-48c5-bbd7-8e678302db81', 'de06071e-9f27-4148-8c68-4454cfeb9c43', 'd856fc8d-8aa3-408e-b517-9906f2a8705d'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:29 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Delete snapshot completed successfully. Jul 05 18:44:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1f27c743-01f7-484a-aa8d-9f4e4db68182 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-3e62264d-1783-43c6-a916-4b4aa100c860-delete_snapshot" released by "delete_snapshot" :: held 4.795s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Creating offline snapshot f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 of volume ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8508e39d-248a-44a4-a267-9251bd04edc6]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:30 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.693s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Deleted volume successfully. Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-10500489-62b0-4b29-9722-b7f9a8233dde tempest-CreateVolumesFromSourceVolumeTest-718727707 None] Lock "cinder-2883c815-21a1-47a9-833b-faee73a94a17-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:30 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 Jul 05 18:44:30 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-065edeb0-a2ec-4da0-9c27-867ab073cb56-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-065edeb0-a2ec-4da0-9c27-867ab073cb56-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-065edeb0-a2ec-4da0-9c27-867ab073cb56" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-065edeb0-a2ec-4da0-9c27-867ab073cb56" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f485715d-f46a-4c21-8bdb-10bbda6c0daa]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:30 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 Jul 05 18:44:30 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:31 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960" returned: 0 in 0.924s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:31 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 1G Jul 05 18:44:31 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:31 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56" returned: 0 in 0.965s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:31 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56 Jul 05 18:44:31 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:32 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 1G" returned: 0 in 1.121s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:32 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 Jul 05 18:44:32 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:32 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-065edeb0-a2ec-4da0-9c27-867ab073cb56" returned: 0 in 0.946s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-065edeb0-a2ec-4da0-9c27-867ab073cb56" released by "delete_volume" :: held 1.988s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Created reservations ['46adea3b-76cf-40da-b0a3-5f42ff8b201e', '8e363731-62c4-41fa-9fb8-7e495d2ebe32', 'e9d6e037-3191-4df9-ac73-228e8dfefdf5', '1cba335a-8539-414a-bac5-df61847b5885'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:32 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:32 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:33 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5" returned: 0 in 0.972s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:33 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 is being set with open permissions: ugo+rw Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:33 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 Jul 05 18:44:33 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (f3dd5270-5a13-4cab-b061-206f0d98807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2ff1ff-a6eb-490f-874b-ec575c403d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:33 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.961s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2ff1ff-a6eb-490f-874b-ec575c403d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912050134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebc3ca7-d2ec-4ba1-afe1-46b256528b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:34Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f44435b-04a9-4049-8d90-a491349f5bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f44435b-04a9-4049-8d90-a491349f5bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0bdaa2-e41f-4121-8b7e-cd17213bbf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0bdaa2-e41f-4121-8b7e-cd17213bbf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebc3ca7-d2ec-4ba1-afe1-46b256528b72', 'volume_name': 'volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6e6de5-88cd-4601-a7bc-3c3ddfd5ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6e6de5-88cd-4601-a7bc-3c3ddfd5ea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a4fdbb-ee85-4f95-8206-724a1a00d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Volume cebc3ca7-d2ec-4ba1-afe1-46b256528b72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72', 'volume_size': 1} Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Deleted volume successfully. Jul 05 18:44:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-96c03129-3b1e-4061-baf7-908853245123 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-065edeb0-a2ec-4da0-9c27-867ab073cb56-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:34 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5" returned: 0 in 0.797s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:34 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.info Jul 05 18:44:34 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:35 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.info" returned: 0 in 0.833s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:35 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.info is being set with open permissions: ugo+rw Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:35 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.info Jul 05 18:44:35 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:35 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.info" returned: 0 in 0.799s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.556s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.142s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912050134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebc3ca7-d2ec-4ba1-afe1-46b256528b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:34Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Creating volume cebc3ca7-d2ec-4ba1-afe1-46b256528b72 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:35 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:44:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:35 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 1073741824 Jul 05 18:44:35 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:36 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c89098bf-6d61-4dfb-9a7c-5eed5b1fb9e7 tempest-SnapshotDependencyTests-517002990 None] Create snapshot completed successfully Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (0175b52d-58c1-49ba-94a2-50ec5b2fe62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5c0241-6bbb-4eec-b7f6-84b592326804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5c0241-6bbb-4eec-b7f6-84b592326804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380516576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc47b22f-2dc0-4d51-a79a-2b926be35b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:36Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d83ec22-7e39-486f-b9b3-1b1b112c75e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d83ec22-7e39-486f-b9b3-1b1b112c75e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab9cdb0-2c05-44cc-9e6d-9868aed12603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab9cdb0-2c05-44cc-9e6d-9868aed12603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc47b22f-2dc0-4d51-a79a-2b926be35b34', 'volume_name': 'volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666f89b1-5ace-4b43-89b4-105945f918bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666f89b1-5ace-4b43-89b4-105945f918bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ce4d97-bef2-4ef1-9e63-58f3b593dd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:36 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Volume cc47b22f-2dc0-4d51-a79a-2b926be35b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34', 'volume_size': 1} Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:36 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 1073741824" returned: 0 in 1.015s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:37 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 Jul 05 18:44:37 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Flow 'volume_create_manager' (1d3a93af-8241-4777-bbac-49257a2ab437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701fb690-7279-4cf8-a208-374d1948c176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701fb690-7279-4cf8-a208-374d1948c176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ee32c1-2266-4e1e-8c7f-20206b9ce2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18cb15e8c06946958ece5f44d47fd14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:37Z,use_quota=True,user_id='9f4c9ba1ce0f4831b7f7877a0a56a824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239601f-7fbb-4742-be69-1e66ee4a7bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239601f-7fbb-4742-be69-1e66ee4a7bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c81392a-0bf0-44f4-a374-d746c764e712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c81392a-0bf0-44f4-a374-d746c764e712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '93ee32c1-2266-4e1e-8c7f-20206b9ce2af', 'volume_name': 'volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af', 'volume_size': 1, 'snapshot_id': 'f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76777224-36f3-4a9f-a79b-46820a4eecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76777224-36f3-4a9f-a79b-46820a4eecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c26a232-46f3-4ccd-8c68-8a92de05d2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:37 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Volume 93ee32c1-2266-4e1e-8c7f-20206b9ce2af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af', 'volume_size': 1, 'snapshot_id': 'f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5'} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:37 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" returned: 0 in 0.762s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.661s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380516576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc47b22f-2dc0-4d51-a79a-2b926be35b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:36Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Creating volume cc47b22f-2dc0-4d51-a79a-2b926be35b34 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:37 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a4fdbb-ee85-4f95-8206-724a1a00d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:37 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 1073741824 Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119e63e7-07b2-49b2-99c3-c4c72c4fc3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:37 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:37 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Volume volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 (cebc3ca7-d2ec-4ba1-afe1-46b256528b72): created successfully Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119e63e7-07b2-49b2-99c3-c4c72c4fc3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:37 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (f3dd5270-5a13-4cab-b061-206f0d98807c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0cce9cfa-a0b8-469d-8025-b3a27a19396e tempest-ProjectReaderTests-1750246745 None] Created volume successfully. Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Flow 'volume_create_manager' (018177d9-bd1d-402e-b5fb-0bfaf3ab85fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de8303a-73bf-4805-aa09-93afdc2543a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de8303a-73bf-4805-aa09-93afdc2543a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014889244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f66cf8-17e7-4d4c-98eb-f397cefe5d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35eb719d6646369df73935af460255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:38Z,use_quota=True,user_id='1eb9e9da88d843f1b973f0c4e1d0ffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ac89b4-cb35-4190-bf79-070321dec474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ac89b4-cb35-4190-bf79-070321dec474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd144f28-f62e-4109-a91a-209146dcc0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd144f28-f62e-4109-a91a-209146dcc0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f66cf8-17e7-4d4c-98eb-f397cefe5d28', 'volume_name': 'volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4faa10d6-5ef7-45b8-a8ad-34c101eed701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4faa10d6-5ef7-45b8-a8ad-34c101eed701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c53784e-4296-4edf-a84e-6f4d4231d68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:38 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Volume 54f66cf8-17e7-4d4c-98eb-f397cefe5d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28', 'volume_size': 1} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:38 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 1073741824" returned: 0 in 0.953s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:38 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 Jul 05 18:44:38 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:39 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34" returned: 0 in 0.677s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.925s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "cinder-quobyte-f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" by "_create_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ce4d97-bef2-4ef1-9e63-58f3b593dd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613ed50a-9ff7-424b-bfdd-10d22fc5e3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Creating volume 93ee32c1-2266-4e1e-8c7f-20206b9ce2af from snapshot f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 {{(pid=86664) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "cinder-quobyte-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" by "_copy_volume_from_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:39 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Volume volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 (cc47b22f-2dc0-4d51-a79a-2b926be35b34): created successfully Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613ed50a-9ff7-424b-bfdd-10d22fc5e3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (0175b52d-58c1-49ba-94a2-50ec5b2fe62c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] snapshot: f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5, volume: 93ee32c1-2266-4e1e-8c7f-20206b9ce2af, {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 05 18:44:39 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5bbd5e0f-31de-40a0-b4a8-cc6b2a949520 tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b1c4fa-f135-4b23-ad5b-43eca8c03003]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:39 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 Jul 05 18:44:39 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:40 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5" returned: 0 in 0.828s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff73c9c4-de49-49ad-a4da-e46032c5e960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:44:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 05 18:44:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Creating direct copy from snapshot {{(pid=86664) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 05 18:44:40 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5042f339-938b-420a-854f-d552dcb2b445]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:40 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 Jul 05 18:44:40 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:41 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960" returned: 0 in 0.763s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:41 devstack cinder-volume[86664]: DEBUG cinder.utils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Path /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af not found in is_blk_device check {{(pid=86664) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 05 18:44:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:41 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af Jul 05 18:44:41 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:45 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" returned: 0 in 4.750s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:45 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ff6e88-b4ba-4b25-a952-3b1994f51cab]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:46 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 Jul 05 18:44:46 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:46 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960" returned: 0 in 0.936s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:46 devstack cinder-volume[86664]: DEBUG cinder.image.image_utils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Image conversion details: src /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af {{(pid=86664) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 05 18:44:46 devstack cinder-volume[86664]: INFO cinder.image.image_utils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Converted 1024.00 MB image at 215.43 MB/s Jul 05 18:44:46 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af is being set with open permissions: ugo+rw Jul 05 18:44:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:46 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af Jul 05 18:44:46 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:47 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" returned: 0 in 0.688s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" released by "_copy_volume_from_snapshot" :: held 8.069s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" released by "_create_volume_from_snapshot" :: held 8.110s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.144s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.268s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2014889244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f66cf8-17e7-4d4c-98eb-f397cefe5d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35eb719d6646369df73935af460255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:38Z,use_quota=True,user_id='1eb9e9da88d843f1b973f0c4e1d0ffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Creating volume 54f66cf8-17e7-4d4c-98eb-f397cefe5d28 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:47 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:INSERT=43,cinder:UPDATE=156,cinder:SELECT=117,cinder:DELETE=12 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:44:47 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 1073741824 Jul 05 18:44:47 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:DELETE=17,cinder:SELECT=116,cinder:INSERT=38,cinder:UPDATE=178 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c26a232-46f3-4ccd-8c68-8a92de05d2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af', 'volume_size': 1, 'snapshot_id': 'f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5'}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fee05a-3905-46f0-8d66-e42fd66e3b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:47 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Volume volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af (93ee32c1-2266-4e1e-8c7f-20206b9ce2af): created successfully Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fee05a-3905-46f0-8d66-e42fd66e3b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:47 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Flow 'volume_create_manager' (1d3a93af-8241-4777-bbac-49257a2ab437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f689d216-c056-484a-8947-c623b85e938f tempest-SnapshotDependencyTests-517002990 None] Created volume successfully. Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "cinder-f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "cinder-quobyte-ff73c9c4-de49-49ad-a4da-e46032c5e960" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-ff73c9c4-de49-49ad-a4da-e46032c5e960" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "cinder-quobyte-f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Deleting offline snapshot f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 of volume ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] snapshot_file for this snap is: volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[5197d227-fb5d-4dea-a1c6-48093ee14df0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:48 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 Jul 05 18:44:48 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:48 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 1073741824" returned: 0 in 0.987s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:48 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 Jul 05 18:44:48 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:49 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5" returned: 0 in 0.837s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff73c9c4-de49-49ad-a4da-e46032c5e960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:44:49 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a08e0-881e-4e19-aa8a-7a53579ab205]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28" returned: 0 in 0.707s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.253s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c53784e-4296-4edf-a84e-6f4d4231d68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bd6ed2-9cbe-4cec-8ac3-5e4e01a72a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Creating offline snapshot 5e57051b-0c45-4b2f-bf80-0dd0e9c43347 of volume cebc3ca7-d2ec-4ba1-afe1-46b256528b72 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:44:49 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Volume volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 (54f66cf8-17e7-4d4c-98eb-f397cefe5d28): created successfully Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bd6ed2-9cbe-4cec-8ac3-5e4e01a72a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Flow 'volume_create_manager' (018177d9-bd1d-402e-b5fb-0bfaf3ab85fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa7f6f8-a34b-44da-8ebc-f6bc3bf34398]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:49 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 Jul 05 18:44:49 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:49 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ab82bbbc-0f9b-48de-94f5-23b900fda72a tempest-ProjectReaderTests-2009040508 None] Created volume successfully. Jul 05 18:44:49 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 Jul 05 18:44:49 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:50 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960" returned: 0 in 0.861s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:50 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 Jul 05 18:44:50 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:50 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" returned: 0 in 0.875s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:50 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 1G Jul 05 18:44:50 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "cinder-54f66cf8-17e7-4d4c-98eb-f397cefe5d28-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-54f66cf8-17e7-4d4c-98eb-f397cefe5d28-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "cinder-quobyte-54f66cf8-17e7-4d4c-98eb-f397cefe5d28" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-quobyte-54f66cf8-17e7-4d4c-98eb-f397cefe5d28" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d5265-bda0-402b-b721-8690ceb1dc2e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:50 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 Jul 05 18:44:50 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:51 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5" returned: 0 in 0.905s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:51 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5 Jul 05 18:44:51 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:51 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 1G" returned: 0 in 0.913s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:51 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 Jul 05 18:44:51 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:51 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28" returned: 0 in 0.849s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:51 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28 Jul 05 18:44:51 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:51 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960.f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5" returned: 0 in 0.701s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5" released by "_delete_snapshot" :: held 3.420s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-ff73c9c4-de49-49ad-a4da-e46032c5e960" released by "delete_snapshot" :: held 3.449s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:51 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Created reservations ['4f81528e-ad71-43da-87c5-d775d3a8143e', '847449c0-8138-4ed1-8aa3-6803351338dc', '80d359e9-443a-46fc-bcd1-91c4788959df', 'e18e8849-446d-4f6d-8a72-41f524c6bc3a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:52 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Delete snapshot completed successfully. Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f3c47099-b8cd-46d2-abb3-c408c119256b tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-f7f6d9d2-3e21-4b89-b6a1-4227d21a2ea5-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:52 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347" returned: 0 in 0.794s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:52 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 is being set with open permissions: ugo+rw Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:52 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 Jul 05 18:44:52 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:52 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-54f66cf8-17e7-4d4c-98eb-f397cefe5d28" returned: 0 in 0.752s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-quobyte-54f66cf8-17e7-4d4c-98eb-f397cefe5d28" released by "delete_volume" :: held 1.657s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Created reservations ['767e0406-e08f-4e53-aa26-0f4b78e0f494', '556b0925-0449-4935-b09f-23361580bb34', 'afd990ce-3b14-4ec0-a10e-9665bd93e78b', '6e46f465-249b-4b52-a1d4-f3621507e1b5'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:52 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:52 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "cinder-ff73c9c4-de49-49ad-a4da-e46032c5e960-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-ff73c9c4-de49-49ad-a4da-e46032c5e960-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:52 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347" returned: 0 in 0.710s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "cinder-quobyte-ff73c9c4-de49-49ad-a4da-e46032c5e960" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:52 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.info Jul 05 18:44:52 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-ff73c9c4-de49-49ad-a4da-e46032c5e960" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e06be6-2f3f-4f25-8dd3-fd471a800334]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:53 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 Jul 05 18:44:53 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:53 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.908s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:53 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Deleted volume successfully. Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e21ff1f9-f719-4d2d-9e7c-bd47215392b9 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-54f66cf8-17e7-4d4c-98eb-f397cefe5d28-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Flow 'volume_create_manager' (41819a3e-ef8d-4330-bda6-66c5ad02b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3b5dcd-6233-4b4c-8b38-73caecd92544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3b5dcd-6233-4b4c-8b38-73caecd92544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1589193541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09645927-781b-4817-ad77-345aa3b042ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35eb719d6646369df73935af460255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:53Z,use_quota=True,user_id='1eb9e9da88d843f1b973f0c4e1d0ffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211afba8-92d3-4114-999d-b09165dd8bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211afba8-92d3-4114-999d-b09165dd8bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d202a1c-38e4-4d28-982b-f2ab33184f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d202a1c-38e4-4d28-982b-f2ab33184f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09645927-781b-4817-ad77-345aa3b042ea', 'volume_name': 'volume-09645927-781b-4817-ad77-345aa3b042ea', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b6af9d-c9b8-44fa-af9a-cc38d05b0da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b6af9d-c9b8-44fa-af9a-cc38d05b0da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d69ece7-51ec-4095-b9ca-4361321f4ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:44:53 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Volume 09645927-781b-4817-ad77-345aa3b042ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09645927-781b-4817-ad77-345aa3b042ea', 'volume_size': 1} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:53 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.info" returned: 0 in 0.761s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:53 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.info is being set with open permissions: ugo+rw Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:53 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.info Jul 05 18:44:53 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:53 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960" returned: 0 in 0.962s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:53 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960 Jul 05 18:44:53 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:54 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.info" returned: 0 in 0.715s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.923s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.751s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot ab6f8c45-748e-4a94-abb8-969cd30aa0d2 of volume cc47b22f-2dc0-4d51-a79a-2b926be35b34 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:44:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-44f20c28-7e7d-445e-ad69-80142477392f tempest-ProjectReaderTests-1750246745 None] Create snapshot completed successfully Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51310be-0d25-43f4-99f5-5b30e04872ff]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:54 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 Jul 05 18:44:54 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:54 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ff73c9c4-de49-49ad-a4da-e46032c5e960" returned: 0 in 0.677s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-ff73c9c4-de49-49ad-a4da-e46032c5e960" released by "delete_volume" :: held 1.735s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Created reservations ['26f6baa3-14b5-42af-bb72-4e5677a81fa7', 'af092f89-80f6-471d-8d20-db2c832016e1', 'c85019ec-860f-4db3-a631-ba461a86702e', '6c25f514-2381-49ec-b3cb-09ff9f383267'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:54 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:54 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-5e57051b-0c45-4b2f-bf80-0dd0e9c43347-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-5e57051b-0c45-4b2f-bf80-0dd0e9c43347-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-5e57051b-0c45-4b2f-bf80-0dd0e9c43347" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-5e57051b-0c45-4b2f-bf80-0dd0e9c43347" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Deleting offline snapshot 5e57051b-0c45-4b2f-bf80-0dd0e9c43347 of volume cebc3ca7-d2ec-4ba1-afe1-46b256528b72 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] snapshot_file for this snap is: volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "cinder-93ee32c1-2266-4e1e-8c7f-20206b9ce2af-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8079e-a969-43c7-bb1a-356fdb0d5c16]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-93ee32c1-2266-4e1e-8c7f-20206b9ce2af-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "cinder-quobyte-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ebdcb8-bc43-4b4d-94b7-2d9ed28ed8fc]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:55 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34" returned: 0 in 0.874s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:55 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 Jul 05 18:44:55 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:55 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 1G Jul 05 18:44:55 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:55 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af Jul 05 18:44:55 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:55 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.829s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:55 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Deleted volume successfully. Jul 05 18:44:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3e0a3d72-cb5f-4ad4-88cb-e038d23d6a74 tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-ff73c9c4-de49-49ad-a4da-e46032c5e960-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:56 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347" returned: 0 in 0.976s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:44:56 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" returned: 0 in 0.878s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[572f9329-eee6-45df-9d3d-26937c4a68e5]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:56 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af Jul 05 18:44:56 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:56 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 1G" returned: 0 in 0.955s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:56 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 Jul 05 18:44:56 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:56 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 Jul 05 18:44:56 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:56 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" returned: 0 in 0.722s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-quobyte-93ee32c1-2266-4e1e-8c7f-20206b9ce2af" released by "delete_volume" :: held 1.655s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Created reservations ['b3d4bdad-caf2-4847-b6fa-558b087fc9bc', 'd868b0ee-7e4e-4d43-96ae-25b18b86f967', '3f50f980-221a-4ef7-8f17-860dd276caf6', '50592c18-5a20-4b95-9db5-ff3296f61225'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:56 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" returned: 0 in 0.841s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:56 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:56 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 Jul 05 18:44:56 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2" returned: 0 in 0.803s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:56 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 is being set with open permissions: ugo+rw Jul 05 18:44:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:57 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:44:57 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:57 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 Jul 05 18:44:57 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:57 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:57 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2" returned: 0 in 0.746s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.769s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:57 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:44:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Deleted volume successfully. Jul 05 18:44:57 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-25a2bc31-7e25-438c-9671-21bc19536a91 tempest-SnapshotDependencyTests-517002990 None] Lock "cinder-93ee32c1-2266-4e1e-8c7f-20206b9ce2af-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:57 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347" returned: 0 in 0.873s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:57 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.info Jul 05 18:44:57 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:57 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347 Jul 05 18:44:57 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:58 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.info" returned: 0 in 0.756s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:58 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.info is being set with open permissions: ugo+rw Jul 05 18:44:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:58 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:58 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.info Jul 05 18:44:58 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72.5e57051b-0c45-4b2f-bf80-0dd0e9c43347" returned: 0 in 0.766s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-5e57051b-0c45-4b2f-bf80-0dd0e9c43347" released by "_delete_snapshot" :: held 3.592s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" released by "delete_snapshot" :: held 3.628s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:58 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Created reservations ['3fb6b54a-a65b-489d-a3a9-abf20e295949', '08c9ab84-a26e-4295-a862-4346c51102cb', '8b045962-b6c5-46d0-a3ae-67abfd6baab2', 'a789d5c7-ab45-4345-9ffc-482f9894987e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:44:58 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Delete snapshot completed successfully. Jul 05 18:44:58 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-847f1ae0-287c-428f-a571-e16c6f0c6964 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-5e57051b-0c45-4b2f-bf80-0dd0e9c43347-delete_snapshot" released by "delete_snapshot" :: held 3.832s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-cebc3ca7-d2ec-4ba1-afe1-46b256528b72-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Lock "cinder-cebc3ca7-d2ec-4ba1-afe1-46b256528b72-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:59 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.info" returned: 0 in 0.747s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.044s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.816s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1589193541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09645927-781b-4817-ad77-345aa3b042ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35eb719d6646369df73935af460255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:44:53Z,use_quota=True,user_id='1eb9e9da88d843f1b973f0c4e1d0ffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Creating volume 09645927-781b-4817-ad77-345aa3b042ea {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:44:59 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:59 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea 1073741824 Jul 05 18:44:59 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:44:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-111137e3-5c3f-4fa7-b69e-b78deaa11975 tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" acquired by "delete_volume" :: waited 0.032s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4b497b-6af0-4c93-9650-ec27ea04450e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:44:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:44:59 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 Jul 05 18:44:59 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:00 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea 1073741824" returned: 0 in 0.961s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:00 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" returned: 0 in 0.896s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:00 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72 Jul 05 18:45:00 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:00 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea Jul 05 18:45:00 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-ab6f8c45-748e-4a94-abb8-969cd30aa0d2-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-ab6f8c45-748e-4a94-abb8-969cd30aa0d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-cc47b22f-2dc0-4d51-a79a-2b926be35b34" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-cc47b22f-2dc0-4d51-a79a-2b926be35b34" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-ab6f8c45-748e-4a94-abb8-969cd30aa0d2" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-ab6f8c45-748e-4a94-abb8-969cd30aa0d2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Deleting offline snapshot ab6f8c45-748e-4a94-abb8-969cd30aa0d2 of volume cc47b22f-2dc0-4d51-a79a-2b926be35b34 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] snapshot_file for this snap is: volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[3560aeb7-15b4-467f-82dd-2ab5a9b8986f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:00 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 Jul 05 18:45:00 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:01 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" returned: 0 in 0.952s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-cebc3ca7-d2ec-4ba1-afe1-46b256528b72" released by "delete_volume" :: held 1.926s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:01 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea" returned: 0 in 1.008s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d69ece7-51ec-4095-b9ca-4361321f4ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09645927-781b-4817-ad77-345aa3b042ea', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec497fb7-05a6-49fa-aa83-7c76fa877f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Created reservations ['d23bf488-7741-4d53-8cd9-818b5880c4ef', '02f8ed23-7658-4530-8bc0-3a151482b7fa', 'b1cc69c9-fa6c-4aad-884f-61b03bafe7b3', '70a89118-5a17-4fb0-afc1-56e8a94d228c'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:01 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Volume volume-09645927-781b-4817-ad77-345aa3b042ea (09645927-781b-4817-ad77-345aa3b042ea): created successfully Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec497fb7-05a6-49fa-aa83-7c76fa877f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Flow 'volume_create_manager' (41819a3e-ef8d-4330-bda6-66c5ad02b60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:01 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-54f962ee-2854-4dba-ba61-24dfba455301 tempest-ProjectReaderTests-2009040508 None] Created volume successfully. Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:01 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:45:01 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:01 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2" returned: 0 in 1.185s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eddad5f-ac73-4657-8485-5ddb5d170986]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:02 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 Jul 05 18:45:02 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "cinder-09645927-781b-4817-ad77-345aa3b042ea-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-09645927-781b-4817-ad77-345aa3b042ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "cinder-quobyte-09645927-781b-4817-ad77-345aa3b042ea" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-quobyte-09645927-781b-4817-ad77-345aa3b042ea" acquired by "delete_volume" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[9194abed-1087-40b9-aa9e-21a4a61eab71]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:02 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.903s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:45:02 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea Jul 05 18:45:02 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Deleted volume successfully. Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-3203f562-e6eb-408a-8ed4-fc8fa620cafe tempest-ProjectReaderTests-1750246745 None] Lock "cinder-cebc3ca7-d2ec-4ba1-afe1-46b256528b72-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:02 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34" returned: 0 in 0.940s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:02 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 Jul 05 18:45:02 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (fd3b5d71-82b0-4fdf-adb1-cdd8e99a4140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8650293-c767-4735-b6ec-d990c92d5b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8650293-c767-4735-b6ec-d990c92d5b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1419753187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ce75b1-d9b9-432d-9f96-6f7d01d8c337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:03Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fdd344-33d6-477a-ae7c-fbf239db83fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fdd344-33d6-477a-ae7c-fbf239db83fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd74eb31-6ab3-4cc4-8f0a-04db95d2e1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd74eb31-6ab3-4cc4-8f0a-04db95d2e1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ce75b1-d9b9-432d-9f96-6f7d01d8c337', 'volume_name': 'volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b0e00f-4662-45dd-9a08-f8dbd05d750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b0e00f-4662-45dd-9a08-f8dbd05d750f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:03 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461561f6-3ca7-40b6-be87-bc7a2ed1dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:03 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Volume f9ce75b1-d9b9-432d-9f96-6f7d01d8c337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337', 'volume_size': 1} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1419753187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ce75b1-d9b9-432d-9f96-6f7d01d8c337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:03Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Creating volume f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:45:03 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea" returned: 0 in 1.097s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:03 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 1073741824 Jul 05 18:45:03 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:03 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea Jul 05 18:45:03 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:03 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2" returned: 0 in 0.993s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:03 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2 Jul 05 18:45:03 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:04 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-09645927-781b-4817-ad77-345aa3b042ea" returned: 0 in 0.854s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-quobyte-09645927-781b-4817-ad77-345aa3b042ea" released by "delete_volume" :: held 2.009s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Created reservations ['f34d9901-7fbf-4a84-9d92-5ce23ad5fa1d', '12114368-927f-4565-911f-d7cb46a8cfdb', '6b88acea-dd2b-468a-909b-6c55d6320b6f', '43443eb1-9d95-4e2b-96da-f5d5f3a6b3ce'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:04 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 1073741824" returned: 0 in 1.107s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:04 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:45:04 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:04 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 Jul 05 18:45:04 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:04 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34.ab6f8c45-748e-4a94-abb8-969cd30aa0d2" returned: 0 in 0.889s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-ab6f8c45-748e-4a94-abb8-969cd30aa0d2" released by "_delete_snapshot" :: held 4.204s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-cc47b22f-2dc0-4d51-a79a-2b926be35b34" released by "delete_snapshot" :: held 4.240s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:04 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Created reservations ['956b8320-c636-4266-9c52-e2d2fccfd6a2', '48626f3e-39af-4785-975a-2f212d69e59c', 'c7f6d2b0-8fb0-4657-b1f7-8b6d8199cc0c', '211fb786-35db-430d-9547-f28cd5196cea'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:05 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Delete snapshot completed successfully. Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5a6e2dee-d618-4461-bc87-4561424b1269 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-ab6f8c45-748e-4a94-abb8-969cd30aa0d2-delete_snapshot" released by "delete_snapshot" :: held 4.528s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Flow 'volume_create_manager' (539e4529-1a5e-4dcc-a290-f0b957208381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6964db73-31f6-4a26-837f-6cdbeab562da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6964db73-31f6-4a26-837f-6cdbeab562da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677206465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c746b82f-dae6-4949-82c8-86b4c2758b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35eb719d6646369df73935af460255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:05Z,use_quota=True,user_id='1eb9e9da88d843f1b973f0c4e1d0ffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69482a9b-7eb7-4b28-a2be-a15c74926ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69482a9b-7eb7-4b28-a2be-a15c74926ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b8eabc-cace-4705-b327-e0b7cbd6d051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b8eabc-cace-4705-b327-e0b7cbd6d051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c746b82f-dae6-4949-82c8-86b4c2758b3b', 'volume_name': 'volume-c746b82f-dae6-4949-82c8-86b4c2758b3b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff4076f-e3e6-4342-bb56-5164dac3ab69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff4076f-e3e6-4342-bb56-5164dac3ab69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9585e165-78fa-4bf4-95fb-8ad1a1215e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:05 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Volume c746b82f-dae6-4949-82c8-86b4c2758b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c746b82f-dae6-4949-82c8-86b4c2758b3b', 'volume_size': 1} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:05 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.905s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:45:05 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Deleted volume successfully. Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6778c5df-99e4-49d6-9d55-642ae313d693 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-09645927-781b-4817-ad77-345aa3b042ea-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:05 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337" returned: 0 in 1.056s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.246s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677206465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c746b82f-dae6-4949-82c8-86b4c2758b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35eb719d6646369df73935af460255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:05Z,use_quota=True,user_id='1eb9e9da88d843f1b973f0c4e1d0ffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Creating volume c746b82f-dae6-4949-82c8-86b4c2758b3b {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:45:05 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461561f6-3ca7-40b6-be87-bc7a2ed1dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:05 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b 1073741824 Jul 05 18:45:05 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65dc8d3-070a-4fb9-8aea-b233d088dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:05 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Volume volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 (f9ce75b1-d9b9-432d-9f96-6f7d01d8c337): created successfully Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65dc8d3-070a-4fb9-8aea-b233d088dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:05 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (fd3b5d71-82b0-4fdf-adb1-cdd8e99a4140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:05 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-08cab7b5-bf49-40af-b508-f2a3e1dadab4 tempest-ProjectReaderTests-1750246745 None] Created volume successfully. Jul 05 18:45:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-cc47b22f-2dc0-4d51-a79a-2b926be35b34-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-cc47b22f-2dc0-4d51-a79a-2b926be35b34-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-cc47b22f-2dc0-4d51-a79a-2b926be35b34" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:06 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-cc47b22f-2dc0-4d51-a79a-2b926be35b34" acquired by "delete_volume" :: waited 0.024s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:06 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dc8bc5-c63f-4aa9-9426-bf08c20fd85f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:06 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 Jul 05 18:45:06 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:06 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b 1073741824" returned: 0 in 1.203s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:06 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b Jul 05 18:45:06 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:07 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34" returned: 0 in 1.083s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:07 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34 Jul 05 18:45:07 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:07 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b" returned: 0 in 0.807s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.973s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Creating offline snapshot b19e2dde-e694-470c-b244-a95255d9e44e of volume f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9585e165-78fa-4bf4-95fb-8ad1a1215e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c746b82f-dae6-4949-82c8-86b4c2758b3b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69931b1-c5bb-441c-bfe1-262daa08fb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[48564a23-7e7e-497e-859f-8fdce87a583f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:07 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Volume volume-c746b82f-dae6-4949-82c8-86b4c2758b3b (c746b82f-dae6-4949-82c8-86b4c2758b3b): created successfully Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69931b1-c5bb-441c-bfe1-262daa08fb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:07 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Flow 'volume_create_manager' (539e4529-1a5e-4dcc-a290-f0b957208381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f2065f10-100b-48aa-8606-a31d9f94e2b8 tempest-ProjectReaderTests-2009040508 None] Created volume successfully. Jul 05 18:45:07 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 Jul 05 18:45:07 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:08 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-cc47b22f-2dc0-4d51-a79a-2b926be35b34" returned: 0 in 0.755s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-cc47b22f-2dc0-4d51-a79a-2b926be35b34" released by "delete_volume" :: held 1.919s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Created reservations ['b7679d88-e459-4d61-83a8-53b3714092af', '415747af-9887-4732-9f9d-40c67c933994', '54b745e7-08e5-4e6d-bea1-ae4c69d1485f', '42a7e2b6-025f-4b53-ae41-7858c4b2fab1'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:08 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:45:08 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "cinder-c746b82f-dae6-4949-82c8-86b4c2758b3b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-c746b82f-dae6-4949-82c8-86b4c2758b3b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:08 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337" returned: 0 in 0.958s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:08 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e 1G Jul 05 18:45:08 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "cinder-quobyte-c746b82f-dae6-4949-82c8-86b4c2758b3b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-quobyte-c746b82f-dae6-4949-82c8-86b4c2758b3b" acquired by "delete_volume" :: waited 0.025s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[935db0b4-ab73-4fc4-9a72-c5555d871761]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:45:09 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b Jul 05 18:45:09 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (99c80429-6e25-4dd3-a9f7-7bbd7178bff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35ed289-56b8-4f29-bbf1-8fb62a5b31e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35ed289-56b8-4f29-bbf1-8fb62a5b31e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385848041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a46879-43b2-4aea-be7c-948c791d9826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:09Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980ffb09-666e-4010-9430-3b025d58ad37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980ffb09-666e-4010-9430-3b025d58ad37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876db6c0-1f33-4257-8288-98577c30830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876db6c0-1f33-4257-8288-98577c30830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a46879-43b2-4aea-be7c-948c791d9826', 'volume_name': 'volume-22a46879-43b2-4aea-be7c-948c791d9826', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ffd306-531a-4a92-b4d0-bbc6fcd811c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ffd306-531a-4a92-b4d0-bbc6fcd811c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ddcd27-fcdd-4c9c-9ea6-5100a1787f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:09 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Volume 22a46879-43b2-4aea-be7c-948c791d9826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a46879-43b2-4aea-be7c-948c791d9826', 'volume_size': 1} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:09 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 1.171s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:45:09 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Deleted volume successfully. Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-1cfcda12-1c5a-45c5-bea0-7abebebb30c0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-cc47b22f-2dc0-4d51-a79a-2b926be35b34-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:09 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b" returned: 0 in 0.966s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:09 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b Jul 05 18:45:09 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:09 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e 1G" returned: 0 in 1.208s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:10 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e Jul 05 18:45:10 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:10 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-c746b82f-dae6-4949-82c8-86b4c2758b3b" returned: 0 in 0.678s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-quobyte-c746b82f-dae6-4949-82c8-86b4c2758b3b" released by "delete_volume" :: held 1.707s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Created reservations ['8ba8ac78-df12-4008-bf92-d258b86216e6', 'd7d36ab5-6d03-4809-a8b9-272cb61ebd8d', '76cac560-c5b0-40a6-829d-20a25fb6f3ee', 'de36a82e-f056-4267-934e-24f8a4ce18f0'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:10 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e" returned: 0 in 0.700s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:10 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e is being set with open permissions: ugo+rw Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:10 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e Jul 05 18:45:10 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:10 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:45:10 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:11 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.b19e2dde-e694-470c-b244-a95255d9e44e" returned: 0 in 0.740s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:11 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.740s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:11 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.info Jul 05 18:45:11 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:45:11 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Deleted volume successfully. Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70a8e130-d295-4cea-8f44-f37bbced40f4 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-c746b82f-dae6-4949-82c8-86b4c2758b3b-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Flow 'volume_create_manager' (4d1c1f31-e1aa-4b3c-80b8-ea95a2995d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1141c5-0618-4e2b-8dae-d2b26321cbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1141c5-0618-4e2b-8dae-d2b26321cbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1362850324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f8e006-1636-4d35-95dc-b1b33b7a4747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35eb719d6646369df73935af460255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:11Z,use_quota=True,user_id='1eb9e9da88d843f1b973f0c4e1d0ffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583a89a2-2a03-4a79-b646-3b5119943975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583a89a2-2a03-4a79-b646-3b5119943975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095d6aff-fc5b-43d3-bd40-1ff8ed1c3855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095d6aff-fc5b-43d3-bd40-1ff8ed1c3855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f8e006-1636-4d35-95dc-b1b33b7a4747', 'volume_name': 'volume-42f8e006-1636-4d35-95dc-b1b33b7a4747', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111a1fd0-e0e9-47ee-849d-39f637dd6172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111a1fd0-e0e9-47ee-849d-39f637dd6172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8096a96-6e77-4f74-b78c-724f174ce864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:11 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Volume 42f8e006-1636-4d35-95dc-b1b33b7a4747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f8e006-1636-4d35-95dc-b1b33b7a4747', 'volume_size': 1} Jul 05 18:45:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:12 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.info" returned: 0 in 0.681s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:12 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.info is being set with open permissions: ugo+rw Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:12 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:45:12 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:12 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.info Jul 05 18:45:12 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:12 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.636s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:45:12 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-f9ce75b1-d9b9-432d-9f96-6f7d01d8c337.info" returned: 0 in 0.701s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.094s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.609s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385848041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a46879-43b2-4aea-be7c-948c791d9826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:09Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Creating volume 22a46879-43b2-4aea-be7c-948c791d9826 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:45:12 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:45:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:12 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 1073741824 Jul 05 18:45:12 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:12 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-87af1064-7251-43cd-80dc-b8e247840703 tempest-ProjectReaderTests-1750246745 None] Create snapshot completed successfully Jul 05 18:45:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a3552973-cbaa-4111-8faf-7c7fe2b51172 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-b19e2dde-e694-470c-b244-a95255d9e44e-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a3552973-cbaa-4111-8faf-7c7fe2b51172 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-b19e2dde-e694-470c-b244-a95255d9e44e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:13 devstack cinder-volume[86664]: INFO cinder.message.api [None req-a3552973-cbaa-4111-8faf-7c7fe2b51172 tempest-ProjectReaderTests-1750246745 None] Creating message record for request_id = req-a3552973-cbaa-4111-8faf-7c7fe2b51172 Jul 05 18:45:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-a3552973-cbaa-4111-8faf-7c7fe2b51172 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-b19e2dde-e694-470c-b244-a95255d9e44e-delete_snapshot" released by "delete_snapshot" :: held 0.053s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server [None req-a3552973-cbaa-4111-8faf-7c7fe2b51172 tempest-ProjectReaderTests-1750246745 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 18:45:13 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server Jul 05 18:45:13 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 1073741824" returned: 0 in 0.825s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:13 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 Jul 05 18:45:13 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:14 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826" returned: 0 in 0.695s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.798s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1362850324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f8e006-1636-4d35-95dc-b1b33b7a4747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d35eb719d6646369df73935af460255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:11Z,use_quota=True,user_id='1eb9e9da88d843f1b973f0c4e1d0ffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Creating volume 42f8e006-1636-4d35-95dc-b1b33b7a4747 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:45:14 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ddcd27-fcdd-4c9c-9ea6-5100a1787f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a46879-43b2-4aea-be7c-948c791d9826', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1292c04a-b36b-4fc2-87cf-5397f0541833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:14 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 1073741824 Jul 05 18:45:14 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:14 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Volume volume-22a46879-43b2-4aea-be7c-948c791d9826 (22a46879-43b2-4aea-be7c-948c791d9826): created successfully Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1292c04a-b36b-4fc2-87cf-5397f0541833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:14 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (99c80429-6e25-4dd3-a9f7-7bbd7178bff3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:14 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b4679f2a-0eae-40b0-9087-12ba9ffe0167 tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:45:15 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 1073741824" returned: 0 in 0.798s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:15 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 Jul 05 18:45:15 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:15 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747" returned: 0 in 0.691s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:45:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.456s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:15 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot 685f082a-50fa-41e9-bd90-7fb54b5c0b6f of volume 22a46879-43b2-4aea-be7c-948c791d9826 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:45:15 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8096a96-6e77-4f74-b78c-724f174ce864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f8e006-1636-4d35-95dc-b1b33b7a4747', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8632ec7b-a6c0-4daa-a702-03aff2161464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfaeb1f-75b7-47f4-a7f1-594861823bb5]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:16 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Volume volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 (42f8e006-1636-4d35-95dc-b1b33b7a4747): created successfully Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8632ec7b-a6c0-4daa-a702-03aff2161464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Flow 'volume_create_manager' (4d1c1f31-e1aa-4b3c-80b8-ea95a2995d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b5f4a424-9f58-48f3-bcbd-866c26ad03b6 tempest-ProjectReaderTests-2009040508 None] Created volume successfully. Jul 05 18:45:16 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 Jul 05 18:45:16 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:16 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826" returned: 0 in 0.798s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "cinder-42f8e006-1636-4d35-95dc-b1b33b7a4747-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:16 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f 1G Jul 05 18:45:16 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-42f8e006-1636-4d35-95dc-b1b33b7a4747-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "cinder-quobyte-42f8e006-1636-4d35-95dc-b1b33b7a4747" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-quobyte-42f8e006-1636-4d35-95dc-b1b33b7a4747" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b90d5b-3736-4783-8a17-62385a1ce3be]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:17 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 Jul 05 18:45:17 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:17 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f 1G" returned: 0 in 0.854s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a46879-43b2-4aea-be7c-948c791d9826 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:17 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a46879-43b2-4aea-be7c-948c791d9826 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f Jul 05 18:45:17 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:17 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747" returned: 0 in 0.782s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:17 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747 Jul 05 18:45:17 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:18 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a46879-43b2-4aea-be7c-948c791d9826 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f" returned: 0 in 0.703s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:18 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f is being set with open permissions: ugo+rw Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:18 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f Jul 05 18:45:18 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:18 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-42f8e006-1636-4d35-95dc-b1b33b7a4747" returned: 0 in 0.707s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-quobyte-42f8e006-1636-4d35-95dc-b1b33b7a4747" released by "delete_volume" :: held 1.550s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Created reservations ['32778e1d-3812-46e2-ac98-5f51551e601c', 'aa42a261-6bef-49ab-b3a0-dcba4f98f2d4', '28f78b1f-bbf5-429e-9d7e-3558d2d180d6', 'd715c06e-ae58-4a2b-870a-619a8d4d9d7b'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:18 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:45:18 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:19 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f" returned: 0 in 0.673s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:19 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.info Jul 05 18:45:19 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:19 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.704s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:19 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:45:19 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Deleted volume successfully. Jul 05 18:45:19 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-b2b955be-74bd-4e28-a91d-953974bd8852 tempest-ProjectReaderTests-2009040508 None] Lock "cinder-42f8e006-1636-4d35-95dc-b1b33b7a4747-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:19 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.info" returned: 0 in 0.750s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:19 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.info is being set with open permissions: ugo+rw Jul 05 18:45:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:19 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.info Jul 05 18:45:19 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:20 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.info" returned: 0 in 0.723s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.589s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:20 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-3c5a084f-2b1b-4f1a-9745-8fc6b8454c9f tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-685f082a-50fa-41e9-bd90-7fb54b5c0b6f-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-685f082a-50fa-41e9-bd90-7fb54b5c0b6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-22a46879-43b2-4aea-be7c-948c791d9826" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-22a46879-43b2-4aea-be7c-948c791d9826" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-685f082a-50fa-41e9-bd90-7fb54b5c0b6f" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-685f082a-50fa-41e9-bd90-7fb54b5c0b6f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Deleting offline snapshot 685f082a-50fa-41e9-bd90-7fb54b5c0b6f of volume 22a46879-43b2-4aea-be7c-948c791d9826 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] snapshot_file for this snap is: volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dc8efb-d86e-4522-b24f-31e8010fa159]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:20 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f Jul 05 18:45:20 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:21 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f" returned: 0 in 0.763s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22a46879-43b2-4aea-be7c-948c791d9826(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:45:21 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b4e057-b25d-4627-941b-e1f0622baa0c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:21 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 Jul 05 18:45:21 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:22 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826" returned: 0 in 0.747s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:22 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f Jul 05 18:45:22 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:23 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f" returned: 0 in 0.725s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:23 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f Jul 05 18:45:23 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:23 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826.685f082a-50fa-41e9-bd90-7fb54b5c0b6f" returned: 0 in 0.650s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-685f082a-50fa-41e9-bd90-7fb54b5c0b6f" released by "_delete_snapshot" :: held 2.979s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-22a46879-43b2-4aea-be7c-948c791d9826" released by "delete_snapshot" :: held 3.000s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:23 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Created reservations ['75476af1-9d92-43c1-914f-d33c5c48c0bf', '4006b26f-473b-41fd-84cc-8a8a039fc587', 'f2d6f8c1-a2f4-4f64-a42c-ab5fd0f3b8ad', '2e5ab6f9-906f-46cc-beb3-df4ab725753a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:23 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Delete snapshot completed successfully. Jul 05 18:45:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dbc22054-db7b-41b6-911b-bb602aeb6ea0 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-685f082a-50fa-41e9-bd90-7fb54b5c0b6f-delete_snapshot" released by "delete_snapshot" :: held 3.139s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:23 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-22a46879-43b2-4aea-be7c-948c791d9826-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-22a46879-43b2-4aea-be7c-948c791d9826-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-22a46879-43b2-4aea-be7c-948c791d9826" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-22a46879-43b2-4aea-be7c-948c791d9826" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:24 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e4930d-9a93-4491-acd4-b8c990590fcc]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:24 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 Jul 05 18:45:24 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:24 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826" returned: 0 in 0.763s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:24 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826 Jul 05 18:45:24 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:25 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-22a46879-43b2-4aea-be7c-948c791d9826" returned: 0 in 0.663s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:25 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-22a46879-43b2-4aea-be7c-948c791d9826" released by "delete_volume" :: held 1.486s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:25 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Created reservations ['a994f77d-a966-4638-9eca-6909809abc6f', '225170ac-1a6b-4f92-aad0-bf4a7519dcbc', '3b11dce9-a8a3-4ce5-9f38-f27bbe107ba6', 'f53b35c4-3cfd-43ad-bb3f-8227b5ce2f16'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:25 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:45:25 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:26 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.636s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:45:26 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Deleted volume successfully. Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-afcb7aa6-00c7-4f4e-8540-3da170463e75 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-22a46879-43b2-4aea-be7c-948c791d9826-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (112e8c53-6e39-4e8c-8310-bdf4c82e8851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed854af-1b64-4623-99f4-05c0db845447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed854af-1b64-4623-99f4-05c0db845447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300821817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6efc006-6021-407f-a429-4a18016467ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:27Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1d66bb-1e29-4f87-8cb9-e9a36bd3e130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1d66bb-1e29-4f87-8cb9-e9a36bd3e130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1d019c-0a9a-42c9-a87c-98963e7ce6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1d019c-0a9a-42c9-a87c-98963e7ce6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6efc006-6021-407f-a429-4a18016467ec', 'volume_name': 'volume-a6efc006-6021-407f-a429-4a18016467ec', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed840f47-6e51-401c-aadd-d5b2e76e9c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed840f47-6e51-401c-aadd-d5b2e76e9c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b88f10c-62cd-4e50-a6e9-bc3aa63697ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:26 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Volume a6efc006-6021-407f-a429-4a18016467ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6efc006-6021-407f-a429-4a18016467ec', 'volume_size': 1} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300821817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6efc006-6021-407f-a429-4a18016467ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:27Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Creating volume a6efc006-6021-407f-a429-4a18016467ec {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:45:26 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:45:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:26 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec 1073741824 Jul 05 18:45:26 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:27 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec 1073741824" returned: 0 in 0.829s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:27 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec Jul 05 18:45:27 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:28 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec" returned: 0 in 0.644s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b88f10c-62cd-4e50-a6e9-bc3aa63697ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6efc006-6021-407f-a429-4a18016467ec', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dacad03-dd67-45cf-87c5-3a1608af9e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:28 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Volume volume-a6efc006-6021-407f-a429-4a18016467ec (a6efc006-6021-407f-a429-4a18016467ec): created successfully Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dacad03-dd67-45cf-87c5-3a1608af9e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (112e8c53-6e39-4e8c-8310-bdf4c82e8851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:28 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7d9261a9-5761-480a-b1ff-b0658ffd67fb tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot f68f8877-2649-4765-b7e5-0e749d9e1e21 of volume a6efc006-6021-407f-a429-4a18016467ec {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae8760d-1940-46c4-a9b3-a713f645a975]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:29 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec Jul 05 18:45:29 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:29 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec" returned: 0 in 0.750s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:29 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 1G Jul 05 18:45:29 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:30 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 1G" returned: 0 in 0.794s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6efc006-6021-407f-a429-4a18016467ec -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:30 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6efc006-6021-407f-a429-4a18016467ec -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 Jul 05 18:45:30 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:31 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6efc006-6021-407f-a429-4a18016467ec -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21" returned: 0 in 0.696s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:31 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 is being set with open permissions: ugo+rw Jul 05 18:45:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:31 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 Jul 05 18:45:31 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:31 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21" returned: 0 in 0.663s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:31 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.info Jul 05 18:45:31 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:32 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.info" returned: 0 in 0.648s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:32 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.info is being set with open permissions: ugo+rw Jul 05 18:45:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:32 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.info Jul 05 18:45:32 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:33 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.info" returned: 0 in 0.640s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.271s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-381e8505-2d98-4d50-b68e-4a88c7915cfa tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-f68f8877-2649-4765-b7e5-0e749d9e1e21-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Lock "cinder-f68f8877-2649-4765-b7e5-0e749d9e1e21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-a6efc006-6021-407f-a429-4a18016467ec" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-a6efc006-6021-407f-a429-4a18016467ec" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-f68f8877-2649-4765-b7e5-0e749d9e1e21" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-f68f8877-2649-4765-b7e5-0e749d9e1e21" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Deleting offline snapshot f68f8877-2649-4765-b7e5-0e749d9e1e21 of volume a6efc006-6021-407f-a429-4a18016467ec {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] snapshot_file for this snap is: volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[565a2686-4f09-4fc4-9783-7723d784caee]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:34 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 Jul 05 18:45:34 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:35 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21" returned: 0 in 0.863s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6efc006-6021-407f-a429-4a18016467ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:45:35 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[33043fb6-157c-4a34-a853-88e811a585a0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:35 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec Jul 05 18:45:35 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:35 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec" returned: 0 in 0.821s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:35 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 Jul 05 18:45:35 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:36 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21" returned: 0 in 0.833s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:36 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21 Jul 05 18:45:36 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:37 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec.f68f8877-2649-4765-b7e5-0e749d9e1e21" returned: 0 in 0.671s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-f68f8877-2649-4765-b7e5-0e749d9e1e21" released by "_delete_snapshot" :: held 3.284s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-a6efc006-6021-407f-a429-4a18016467ec" released by "delete_snapshot" :: held 3.310s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:37 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Created reservations ['f834709b-54b4-405f-ac93-d35441c11e19', '2b51f1dc-88da-4f6f-a9cf-bb0a994c8bc3', '883cbbd9-e830-4df3-8341-7dfdc833b86b', '801493f6-a99f-4142-8ffd-0d512ee26491'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Delete snapshot completed successfully. Jul 05 18:45:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-dd20ba92-a866-4712-bbac-e4b934f2ff7e tempest-ProjectMemberTests-1841497491 None] Lock "cinder-f68f8877-2649-4765-b7e5-0e749d9e1e21-delete_snapshot" released by "delete_snapshot" :: held 3.458s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-a6efc006-6021-407f-a429-4a18016467ec-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Lock "cinder-a6efc006-6021-407f-a429-4a18016467ec-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-a6efc006-6021-407f-a429-4a18016467ec" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-a6efc006-6021-407f-a429-4a18016467ec" acquired by "delete_volume" :: waited 0.014s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd56dd04-ad91-4df0-8d0d-97e1a2e2e97a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:38 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec Jul 05 18:45:38 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:39 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec" returned: 0 in 0.775s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:39 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec Jul 05 18:45:39 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:39 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-a6efc006-6021-407f-a429-4a18016467ec" returned: 0 in 0.653s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:39 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-a6efc006-6021-407f-a429-4a18016467ec" released by "delete_volume" :: held 1.484s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:39 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Created reservations ['1c705ec0-3179-4fdb-aca5-48f9f02de69c', 'eb04df81-42d4-4a75-ac36-994f266f6d85', '9ae63b44-26d9-4806-ad13-b87fbb2ac9c5', '28300d52-fe5c-4482-b4eb-1a71155a12bd'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:40 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:45:40 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:40 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.673s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:40 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:45:40 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Deleted volume successfully. Jul 05 18:45:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-6f5ae843-de4a-4c55-b0bf-d01bc95023bf tempest-ProjectMemberTests-1841497491 None] Lock "cinder-a6efc006-6021-407f-a429-4a18016467ec-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (750e2b8c-fb03-490a-8e61-b96859eee55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3a88a3-72ff-4043-be02-87ecf0191bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb3a88a3-72ff-4043-be02-87ecf0191bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584516784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a2c310-44b1-47f6-8499-154e3bdb469b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:41Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af9931d-ecfa-43f3-bff6-cee9030c8da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af9931d-ecfa-43f3-bff6-cee9030c8da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c35f0a-11f6-4208-9935-83661c03d842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c35f0a-11f6-4208-9935-83661c03d842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a2c310-44b1-47f6-8499-154e3bdb469b', 'volume_name': 'volume-58a2c310-44b1-47f6-8499-154e3bdb469b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57368635-1ac9-4b26-b5a1-e5f98d9d36d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57368635-1ac9-4b26-b5a1-e5f98d9d36d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae42e43-13cc-4558-8538-25b87e2c5d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:41 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Volume 58a2c310-44b1-47f6-8499-154e3bdb469b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a2c310-44b1-47f6-8499-154e3bdb469b', 'volume_size': 1} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584516784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a2c310-44b1-47f6-8499-154e3bdb469b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:41Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Creating volume 58a2c310-44b1-47f6-8499-154e3bdb469b {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:45:41 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:45:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:41 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b 1073741824 Jul 05 18:45:41 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:42 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b 1073741824" returned: 0 in 0.816s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:42 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b Jul 05 18:45:42 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:42 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b" returned: 0 in 0.640s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:45:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae42e43-13cc-4558-8538-25b87e2c5d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a2c310-44b1-47f6-8499-154e3bdb469b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ab9439-103f-45e2-87bd-f0756614f3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:42 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Volume volume-58a2c310-44b1-47f6-8499-154e3bdb469b (58a2c310-44b1-47f6-8499-154e3bdb469b): created successfully Jul 05 18:45:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ab9439-103f-45e2-87bd-f0756614f3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:42 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (750e2b8c-fb03-490a-8e61-b96859eee55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-934e4b26-a988-4fc8-bf84-8e74a2e968f9 tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:45:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot 53ab0612-e705-4cc1-b4cc-03e6d8a83c9d of volume 58a2c310-44b1-47f6-8499-154e3bdb469b {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:45:43 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[264378af-04b9-42c0-91f1-3ec4684539c1]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:43 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b Jul 05 18:45:43 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:44 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b" returned: 0 in 0.741s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:44 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d 1G Jul 05 18:45:44 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:44 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d 1G" returned: 0 in 0.798s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a2c310-44b1-47f6-8499-154e3bdb469b -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:44 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a2c310-44b1-47f6-8499-154e3bdb469b -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d Jul 05 18:45:44 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:45 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58a2c310-44b1-47f6-8499-154e3bdb469b -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d" returned: 0 in 0.739s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:45 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d is being set with open permissions: ugo+rw Jul 05 18:45:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:45 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d Jul 05 18:45:45 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:46 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d" returned: 0 in 0.640s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:46 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.info Jul 05 18:45:46 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:47 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.info" returned: 0 in 0.715s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:47 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.info is being set with open permissions: ugo+rw Jul 05 18:45:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:47 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.info Jul 05 18:45:47 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:47 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.info" returned: 0 in 0.657s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.366s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:47 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-57931001-99fd-4501-9cd0-4cd2f66002da tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-53ab0612-e705-4cc1-b4cc-03e6d8a83c9d-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-53ab0612-e705-4cc1-b4cc-03e6d8a83c9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-58a2c310-44b1-47f6-8499-154e3bdb469b" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-58a2c310-44b1-47f6-8499-154e3bdb469b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-53ab0612-e705-4cc1-b4cc-03e6d8a83c9d" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-53ab0612-e705-4cc1-b4cc-03e6d8a83c9d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Deleting offline snapshot 53ab0612-e705-4cc1-b4cc-03e6d8a83c9d of volume 58a2c310-44b1-47f6-8499-154e3bdb469b {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] snapshot_file for this snap is: volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8d087-ba99-46ef-ac83-6f620f5558ad]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:48 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d Jul 05 18:45:48 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:49 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d" returned: 0 in 0.790s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:49 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58a2c310-44b1-47f6-8499-154e3bdb469b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:45:49 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12e4c94-99ad-469a-aa38-c2ce406877a4]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:49 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b Jul 05 18:45:49 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:50 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b" returned: 0 in 0.753s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:50 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d Jul 05 18:45:50 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:50 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d" returned: 0 in 0.757s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:50 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d Jul 05 18:45:50 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:51 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b.53ab0612-e705-4cc1-b4cc-03e6d8a83c9d" returned: 0 in 0.666s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-53ab0612-e705-4cc1-b4cc-03e6d8a83c9d" released by "_delete_snapshot" :: held 3.066s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-58a2c310-44b1-47f6-8499-154e3bdb469b" released by "delete_snapshot" :: held 3.090s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:51 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=140,cinder:SELECT=107,cinder:INSERT=34,cinder:DELETE=11 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:45:51 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=142,cinder:DELETE=14,cinder:SELECT=107,cinder:INSERT=41 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:45:51 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Created reservations ['867ecf93-b4f2-4cb6-87dc-3d4230761518', 'dfbe46bf-4de7-470d-ab97-efe633363ccf', '6cf9f549-ba9a-4acc-8adf-d94b0427cc2c', '7b39f266-0d0e-4973-b2a5-a74ea462d747'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:51 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Delete snapshot completed successfully. Jul 05 18:45:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-952f3123-5e3f-4851-9e0b-b796ef813dd1 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-53ab0612-e705-4cc1-b4cc-03e6d8a83c9d-delete_snapshot" released by "delete_snapshot" :: held 3.231s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-58a2c310-44b1-47f6-8499-154e3bdb469b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-58a2c310-44b1-47f6-8499-154e3bdb469b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-58a2c310-44b1-47f6-8499-154e3bdb469b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:45:52 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-58a2c310-44b1-47f6-8499-154e3bdb469b" acquired by "delete_volume" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:45:52 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b71ad4-e59f-4f7b-8cc8-35de65a05945]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:52 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b Jul 05 18:45:52 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:53 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b" returned: 0 in 0.741s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:53 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b Jul 05 18:45:53 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:54 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-58a2c310-44b1-47f6-8499-154e3bdb469b" returned: 0 in 0.639s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-58a2c310-44b1-47f6-8499-154e3bdb469b" released by "delete_volume" :: held 1.437s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:54 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Created reservations ['382dcbc5-3589-4b28-ad48-43de934365fa', 'faa67c75-7d92-467d-8f30-1670f7dfb508', '433003ab-2d07-4c48-a894-98d2cfef89d0', '547fbb82-9546-4e7a-a3ac-b142b5ec74ee'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:45:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:54 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:54 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:45:54 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:55 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.706s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:45:55 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Deleted volume successfully. Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-9ececb59-5d37-439b-8801-d384c1095be5 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-58a2c310-44b1-47f6-8499-154e3bdb469b-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (1bf63f0e-edf1-422c-b111-f2d4b874902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a95f4d-50a8-4c19-bc5e-044335532279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a95f4d-50a8-4c19-bc5e-044335532279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095969537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a438dfe-7376-4899-9c68-036baf0ae8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:55Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400a0a02-3965-4b8f-b728-e03296afe09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400a0a02-3965-4b8f-b728-e03296afe09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7d8dd9-5b33-4109-84e4-e9f5345eb5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7d8dd9-5b33-4109-84e4-e9f5345eb5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a438dfe-7376-4899-9c68-036baf0ae8a6', 'volume_name': 'volume-5a438dfe-7376-4899-9c68-036baf0ae8a6', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923b647f-9d57-40b0-87b7-e4f948fb9fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923b647f-9d57-40b0-87b7-e4f948fb9fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0877822-01c2-4b82-b340-d0fa01a8e986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:55 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Volume 5a438dfe-7376-4899-9c68-036baf0ae8a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a438dfe-7376-4899-9c68-036baf0ae8a6', 'volume_size': 1} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095969537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a438dfe-7376-4899-9c68-036baf0ae8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:45:55Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Creating volume 5a438dfe-7376-4899-9c68-036baf0ae8a6 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:45:55 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:45:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:55 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 1073741824 Jul 05 18:45:55 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:56 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 1073741824" returned: 0 in 0.862s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:56 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 Jul 05 18:45:56 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:57 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6" returned: 0 in 0.623s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0877822-01c2-4b82-b340-d0fa01a8e986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a438dfe-7376-4899-9c68-036baf0ae8a6', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c249d1e1-3419-4a15-a9ca-add8a2f30b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:45:57 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Volume volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 (5a438dfe-7376-4899-9c68-036baf0ae8a6): created successfully Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c249d1e1-3419-4a15-a9ca-add8a2f30b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (1bf63f0e-edf1-422c-b111-f2d4b874902b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:45:57 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-98f1bd2f-162d-4b94-8af8-ec8b2479d64c tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot 6f3a0d3a-6e06-44af-b614-63c7d96faeec of volume 5a438dfe-7376-4899-9c68-036baf0ae8a6 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bc2f1d-630d-4efb-b1e3-6447a7592fea]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:45:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:57 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 Jul 05 18:45:57 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:58 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6" returned: 0 in 0.790s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:58 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec 1G Jul 05 18:45:58 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:45:59 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 05 18:45:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec 1G" returned: 0 in 0.823s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:45:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:45:59 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec Jul 05 18:45:59 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:46:00 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 05 18:46:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a438dfe-7376-4899-9c68-036baf0ae8a6 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec" returned: 0 in 0.732s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:46:00 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec is being set with open permissions: ugo+rw Jul 05 18:46:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:46:00 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec Jul 05 18:46:00 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:46:00 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 05 18:46:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.6f3a0d3a-6e06-44af-b614-63c7d96faeec" returned: 0 in 0.651s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:46:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:46:00 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.info Jul 05 18:46:00 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:46:01 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 05 18:46:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.info" returned: 0 in 0.631s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:46:01 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.info is being set with open permissions: ugo+rw Jul 05 18:46:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:46:01 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.info Jul 05 18:46:01 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:46:02 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 05 18:46:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-5a438dfe-7376-4899-9c68-036baf0ae8a6.info" returned: 0 in 0.618s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:46:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.371s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:46:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-20f795e6-940d-46cc-b47f-f313b5fac440 tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:46:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6a1eb72-6fe9-4cf9-b7c8-a350282452e3 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-6f3a0d3a-6e06-44af-b614-63c7d96faeec-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:46:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6a1eb72-6fe9-4cf9-b7c8-a350282452e3 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-6f3a0d3a-6e06-44af-b614-63c7d96faeec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:46:02 devstack cinder-volume[86664]: INFO cinder.message.api [None req-d6a1eb72-6fe9-4cf9-b7c8-a350282452e3 tempest-ProjectMemberTests-1841497491 None] Creating message record for request_id = req-d6a1eb72-6fe9-4cf9-b7c8-a350282452e3 Jul 05 18:46:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-d6a1eb72-6fe9-4cf9-b7c8-a350282452e3 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-6f3a0d3a-6e06-44af-b614-63c7d96faeec-delete_snapshot" released by "delete_snapshot" :: held 0.033s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server [None req-d6a1eb72-6fe9-4cf9-b7c8-a350282452e3 tempest-ProjectMemberTests-1841497491 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server raise self.value Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 05 18:46:02 devstack cinder-volume[86664]: ERROR oslo_messaging.rpc.server Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:46:12 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:46:12 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:46:12 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.650s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:46:12 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:47:12 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:47:12 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:47:12 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.636s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:47:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:47:27 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:12 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:48:12 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:12 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.668s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:48:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (a5a8b296-b417-4118-8c5f-d7661d8845e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd33e76-6b17-4051-bb09-cf99585702c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd33e76-6b17-4051-bb09-cf99585702c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144838239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:48:30Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cb33a4-b36a-4e8e-a0f4-2eeefbf430c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7cb33a4-b36a-4e8e-a0f4-2eeefbf430c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ba51e7-2d6a-4610-ac23-1e332dc6f728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ba51e7-2d6a-4610-ac23-1e332dc6f728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253', 'volume_name': 'volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238577cb-d1dc-41ff-9dee-cc78a446382f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238577cb-d1dc-41ff-9dee-cc78a446382f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3872f9-049c-4239-a850-fc34035ab167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:30 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Volume 0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253', 'volume_size': 1} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144838239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:48:30Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Creating volume 0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:48:30 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:48:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:30 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 1073741824 Jul 05 18:48:30 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:31 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 1073741824" returned: 0 in 0.866s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:31 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 Jul 05 18:48:31 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:32 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" returned: 0 in 0.666s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3872f9-049c-4239-a850-fc34035ab167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22eae34b-8690-4c1e-80f6-4ba57360e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:32 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Volume volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 (0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253): created successfully Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22eae34b-8690-4c1e-80f6-4ba57360e151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (a5a8b296-b417-4118-8c5f-d7661d8845e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:48:32 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-ff674b9a-98be-45cd-b792-8918ecfa228f tempest-ProjectReaderTests-1750246745 None] Created volume successfully. Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Creating offline snapshot afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a of volume 0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[783e762a-993b-46da-b60e-16e2c185a542]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:48:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:32 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 Jul 05 18:48:32 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:33 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" returned: 0 in 0.759s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:33 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a 1G Jul 05 18:48:33 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:34 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a 1G" returned: 0 in 0.797s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:34 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a Jul 05 18:48:34 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:35 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a" returned: 0 in 0.701s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:35 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a is being set with open permissions: ugo+rw Jul 05 18:48:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:35 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a Jul 05 18:48:35 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:35 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a" returned: 0 in 0.650s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:35 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.info Jul 05 18:48:35 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:36 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.info" returned: 0 in 0.675s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:36 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.info is being set with open permissions: ugo+rw Jul 05 18:48:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:36 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.info Jul 05 18:48:36 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:37 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.info" returned: 0 in 0.637s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.305s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:37 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7b5bb707-0d46-443b-b5f4-79f07f4839fa tempest-ProjectReaderTests-1750246745 None] Create snapshot completed successfully Jul 05 18:48:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Deleting offline snapshot afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a of volume 0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:48:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] snapshot_file for this snap is: volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:48:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa08b0c2-069c-49e4-887a-c33688775923]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:48:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:38 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a Jul 05 18:48:38 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:38 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a" returned: 0 in 0.761s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:48:38 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ed28bf-939d-4188-83e6-943369e02e43]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:48:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:38 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 Jul 05 18:48:38 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:39 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" returned: 0 in 0.767s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:39 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a Jul 05 18:48:39 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:40 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a" returned: 0 in 0.714s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:40 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a Jul 05 18:48:40 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:40 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253.afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a" returned: 0 in 0.625s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a" released by "_delete_snapshot" :: held 2.976s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" released by "delete_snapshot" :: held 2.997s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:41 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Created reservations ['10b9bb9e-3b6f-45a8-8051-512365a2e7f2', '4d2f474f-2a2f-4488-803d-e25c2a1f49c7', '812191d9-3dfc-4a69-ad48-db9ad1c4288a', '0034dafe-7614-4af0-84ab-85d54fcdb603'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:48:41 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Delete snapshot completed successfully. Jul 05 18:48:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-22408bfe-a829-4107-8062-3b7f1c099f37 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-afb0dc88-cfb0-4d05-bc9d-bdc7ea756d6a-delete_snapshot" released by "delete_snapshot" :: held 3.146s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bb6c49-6e60-4a60-bb44-dcb916e125c9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:48:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:41 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 Jul 05 18:48:41 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:42 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" returned: 0 in 0.744s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:42 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253 Jul 05 18:48:42 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:42 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" returned: 0 in 0.672s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253" released by "delete_volume" :: held 1.484s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Created reservations ['221b9a4f-f27a-49d4-9904-db75a14c2138', '63c801c5-41c5-490b-b4c0-635463ba552e', '509f6de1-aded-4bd7-9909-0b1367b99d85', 'e89f9c06-196e-45a1-8231-f9f4e18d9007'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:42 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:48:42 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:43 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.653s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:48:43 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Deleted volume successfully. Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-bcebaa8b-57a5-4611-b72b-6da478e16d19 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-0bc9d731-2d8d-48cc-8f4c-44ca4e5d5253-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (c42c7b10-6863-4763-abd6-4ccebd322ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06da0895-2f18-4595-87d1-5cf25fb7923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06da0895-2f18-4595-87d1-5cf25fb7923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513588415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ad1361-265b-4d4c-99f2-d4b35dd44eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:48:44Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcb91a4-6c97-4f07-a914-2ad588ee1be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcb91a4-6c97-4f07-a914-2ad588ee1be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0767a8c7-de81-46da-8863-90190e721cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0767a8c7-de81-46da-8863-90190e721cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ad1361-265b-4d4c-99f2-d4b35dd44eef', 'volume_name': 'volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7658e3-12ae-4395-a854-f672ed7b1a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7658e3-12ae-4395-a854-f672ed7b1a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5cabef8-0a2f-4691-bbde-1c2fc4d4af2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:43 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Volume 77ad1361-265b-4d4c-99f2-d4b35dd44eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef', 'volume_size': 1} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513588415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ad1361-265b-4d4c-99f2-d4b35dd44eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:48:44Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Creating volume 77ad1361-265b-4d4c-99f2-d4b35dd44eef {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:48:43 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:48:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:43 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef 1073741824 Jul 05 18:48:43 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:44 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef 1073741824" returned: 0 in 0.818s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:44 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef Jul 05 18:48:44 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:45 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef" returned: 0 in 0.639s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:45 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:48:45 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5cabef8-0a2f-4691-bbde-1c2fc4d4af2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a162a727-7e6f-457c-8a1b-620ed53b346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:45 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Volume volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef (77ad1361-265b-4d4c-99f2-d4b35dd44eef): created successfully Jul 05 18:48:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a162a727-7e6f-457c-8a1b-620ed53b346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:45 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (c42c7b10-6863-4763-abd6-4ccebd322ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:48:45 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a08b172f-5fb2-4179-9868-20c93fe6a8ce tempest-ProjectReaderTests-1750246745 None] Created volume successfully. Jul 05 18:48:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:46 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Creating offline snapshot 6d188ba9-568a-498e-8335-d256dcd9fc4e of volume 77ad1361-265b-4d4c-99f2-d4b35dd44eef {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:48:46 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[1859fde5-df98-41b1-91c6-62ae1769fdf7]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:48:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:46 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef Jul 05 18:48:46 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:46 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef" returned: 0 in 0.740s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:46 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e 1G Jul 05 18:48:46 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:47 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e 1G" returned: 0 in 0.759s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:47 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e Jul 05 18:48:47 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:48 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e" returned: 0 in 0.698s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:48 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e is being set with open permissions: ugo+rw Jul 05 18:48:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:48 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e Jul 05 18:48:48 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:48 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e" returned: 0 in 0.647s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:48 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.info Jul 05 18:48:48 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:49 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.info" returned: 0 in 0.666s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:49 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.info is being set with open permissions: ugo+rw Jul 05 18:48:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:49 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.info Jul 05 18:48:49 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:50 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.info" returned: 0 in 0.672s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.260s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:50 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-51e0eb2e-e51d-479c-ad40-4f715f75f0b6 tempest-ProjectReaderTests-1750246745 None] Create snapshot completed successfully Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-6d188ba9-568a-498e-8335-d256dcd9fc4e-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-6d188ba9-568a-498e-8335-d256dcd9fc4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-77ad1361-265b-4d4c-99f2-d4b35dd44eef" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-77ad1361-265b-4d4c-99f2-d4b35dd44eef" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-6d188ba9-568a-498e-8335-d256dcd9fc4e" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-6d188ba9-568a-498e-8335-d256dcd9fc4e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Deleting offline snapshot 6d188ba9-568a-498e-8335-d256dcd9fc4e of volume 77ad1361-265b-4d4c-99f2-d4b35dd44eef {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] snapshot_file for this snap is: volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0bf9e6-dd90-4e66-944b-c9ba1c97d14c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:48:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:51 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e Jul 05 18:48:51 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:52 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e" returned: 0 in 0.758s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:52 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:48:52 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[283a81e7-5c95-40bf-b80a-29549b2413d9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:48:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:52 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef Jul 05 18:48:52 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:52 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef" returned: 0 in 0.750s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:52 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e Jul 05 18:48:52 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:53 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e" returned: 0 in 0.724s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:53 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e Jul 05 18:48:53 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:54 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef.6d188ba9-568a-498e-8335-d256dcd9fc4e" returned: 0 in 0.641s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-6d188ba9-568a-498e-8335-d256dcd9fc4e" released by "_delete_snapshot" :: held 2.959s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-77ad1361-265b-4d4c-99f2-d4b35dd44eef" released by "delete_snapshot" :: held 2.981s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Created reservations ['5f3da039-ee71-468a-90db-a80d1964a807', 'bb200cfc-449e-4833-9d8d-cda7d21c1c5f', '7a10acd6-7c31-4e53-a76f-d1901129e193', 'ba95ab1e-7398-48b3-90d8-48de889b7b4b'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:48:54 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Delete snapshot completed successfully. Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5fe3c128-dc14-463d-9656-22dc6a1d01b9 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-6d188ba9-568a-498e-8335-d256dcd9fc4e-delete_snapshot" released by "delete_snapshot" :: held 3.116s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-77ad1361-265b-4d4c-99f2-d4b35dd44eef-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-77ad1361-265b-4d4c-99f2-d4b35dd44eef-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-77ad1361-265b-4d4c-99f2-d4b35dd44eef" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-77ad1361-265b-4d4c-99f2-d4b35dd44eef" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51d425e-c796-4067-893e-038281c6bd04]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:48:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:54 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef Jul 05 18:48:54 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:55 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef" returned: 0 in 0.754s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:55 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef Jul 05 18:48:55 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:55 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-77ad1361-265b-4d4c-99f2-d4b35dd44eef" returned: 0 in 0.637s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:55 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-77ad1361-265b-4d4c-99f2-d4b35dd44eef" released by "delete_volume" :: held 1.447s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Created reservations ['1edf38fd-747f-4cd4-9d38-182cb6ca0d7e', '68ff2dd7-b6fd-4112-8e0b-a2ccfeab393e', 'faea5d83-3fca-463b-b790-afeb95aa4918', '611eefe1-33bc-4b4a-aa44-95149182fd25'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:56 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:48:56 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:56 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.664s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:48:56 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Deleted volume successfully. Jul 05 18:48:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-70c58f23-98bc-44cc-9467-0a14b2094397 tempest-ProjectReaderTests-1750246745 None] Lock "cinder-77ad1361-265b-4d4c-99f2-d4b35dd44eef-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (da305e7a-7a92-452b-9660-2ca7efaee6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804caa07-8f9d-4107-8218-a72d9dc94c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (804caa07-8f9d-4107-8218-a72d9dc94c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1149107239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ef994a-82c1-460a-b774-e787d0fbd45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:48:57Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b187a35a-9b31-426f-8590-7eeb1b9ca053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b187a35a-9b31-426f-8590-7eeb1b9ca053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae4b87a-625a-480f-b8ee-5d981fbe44fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae4b87a-625a-480f-b8ee-5d981fbe44fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ef994a-82c1-460a-b774-e787d0fbd45f', 'volume_name': 'volume-70ef994a-82c1-460a-b774-e787d0fbd45f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8eb5188-52f3-46ca-9437-07f55384b4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8eb5188-52f3-46ca-9437-07f55384b4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a27dfd5-9db6-4f47-b309-11cfef727839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:57 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Volume 70ef994a-82c1-460a-b774-e787d0fbd45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ef994a-82c1-460a-b774-e787d0fbd45f', 'volume_size': 1} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1149107239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ef994a-82c1-460a-b774-e787d0fbd45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21a5c3d756ad4f3faf967480af679a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:48:57Z,use_quota=True,user_id='707fbfd121204610acbf359f16f6f11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Creating volume 70ef994a-82c1-460a-b774-e787d0fbd45f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:48:57 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:48:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:57 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f 1073741824 Jul 05 18:48:57 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:58 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f 1073741824" returned: 0 in 0.848s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:58 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f Jul 05 18:48:58 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:48:58 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 05 18:48:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f" returned: 0 in 0.620s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:48:58 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:48:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:48:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a27dfd5-9db6-4f47-b309-11cfef727839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ef994a-82c1-460a-b774-e787d0fbd45f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e469f656-54e9-43bf-9ee5-18b67e07ef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:48:58 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Volume volume-70ef994a-82c1-460a-b774-e787d0fbd45f (70ef994a-82c1-460a-b774-e787d0fbd45f): created successfully Jul 05 18:48:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e469f656-54e9-43bf-9ee5-18b67e07ef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:48:58 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Flow 'volume_create_manager' (da305e7a-7a92-452b-9660-2ca7efaee6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:48:58 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-6e7bf132-bf5f-4573-8b63-c62a134a562c tempest-ProjectReaderTests-1750246745 None] Created volume successfully. Jul 05 18:48:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:48:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:48:59 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Creating offline snapshot 0c84b8f2-1cd7-42a6-87de-3be561cb35c7 of volume 70ef994a-82c1-460a-b774-e787d0fbd45f {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:48:59 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[35537ccc-fbde-4d75-a051-390226012d61]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:48:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:48:59 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f Jul 05 18:48:59 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:00 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f" returned: 0 in 0.757s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:00 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 1G Jul 05 18:49:00 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:00 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 1G" returned: 0 in 0.783s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ef994a-82c1-460a-b774-e787d0fbd45f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:00 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ef994a-82c1-460a-b774-e787d0fbd45f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 Jul 05 18:49:00 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:01 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ef994a-82c1-460a-b774-e787d0fbd45f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7" returned: 0 in 0.677s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:01 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 is being set with open permissions: ugo+rw Jul 05 18:49:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:01 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 Jul 05 18:49:01 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:02 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7" returned: 0 in 0.622s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:02 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.info Jul 05 18:49:02 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:02 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.info" returned: 0 in 0.664s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:02 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.info is being set with open permissions: ugo+rw Jul 05 18:49:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:02 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.info Jul 05 18:49:02 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:03 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.info" returned: 0 in 0.638s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.219s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:03 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-fc5e7fae-7e0a-40da-8744-6f55adb28d4f tempest-ProjectReaderTests-1750246745 None] Create snapshot completed successfully Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-0c84b8f2-1cd7-42a6-87de-3be561cb35c7-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Lock "cinder-0c84b8f2-1cd7-42a6-87de-3be561cb35c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-70ef994a-82c1-460a-b774-e787d0fbd45f" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-70ef994a-82c1-460a-b774-e787d0fbd45f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-0c84b8f2-1cd7-42a6-87de-3be561cb35c7" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-0c84b8f2-1cd7-42a6-87de-3be561cb35c7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Deleting offline snapshot 0c84b8f2-1cd7-42a6-87de-3be561cb35c7 of volume 70ef994a-82c1-460a-b774-e787d0fbd45f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] snapshot_file for this snap is: volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[303b3584-d2b2-49d9-8a61-b69da9914bc9]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:04 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 Jul 05 18:49:04 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:05 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7" returned: 0 in 0.777s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ef994a-82c1-460a-b774-e787d0fbd45f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:49:05 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2a5d46-1e30-4524-a9c6-d6481dfc152c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:05 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f Jul 05 18:49:05 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:06 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f" returned: 0 in 0.738s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:06 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 Jul 05 18:49:06 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:06 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7" returned: 0 in 0.760s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:06 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7 Jul 05 18:49:06 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:07 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f.0c84b8f2-1cd7-42a6-87de-3be561cb35c7" returned: 0 in 0.649s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-0c84b8f2-1cd7-42a6-87de-3be561cb35c7" released by "_delete_snapshot" :: held 3.027s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-70ef994a-82c1-460a-b774-e787d0fbd45f" released by "delete_snapshot" :: held 3.049s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:07 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Created reservations ['63ce9c9c-5f75-491d-a09c-1eaaa4160922', '90632581-38ec-4433-807a-aaae38a73d9c', '7ff373b4-7fd4-4ecb-8142-cc79989afe2f', 'bb0b5ff3-a90d-4944-85be-a6d2e605dd01'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:49:07 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Delete snapshot completed successfully. Jul 05 18:49:07 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-f5caef5a-6ef3-4c0d-b288-299a544d82aa tempest-ProjectReaderTests-1750246745 None] Lock "cinder-0c84b8f2-1cd7-42a6-87de-3be561cb35c7-delete_snapshot" released by "delete_snapshot" :: held 3.184s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-70ef994a-82c1-460a-b774-e787d0fbd45f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Lock "cinder-70ef994a-82c1-460a-b774-e787d0fbd45f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Acquiring lock "cinder-quobyte-70ef994a-82c1-460a-b774-e787d0fbd45f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:08 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-70ef994a-82c1-460a-b774-e787d0fbd45f" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:08 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[05895994-da9e-43ad-967e-e66135fcf606]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:08 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f Jul 05 18:49:08 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:09 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f" returned: 0 in 0.758s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:09 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f Jul 05 18:49:09 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:10 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-70ef994a-82c1-460a-b774-e787d0fbd45f" returned: 0 in 0.627s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Lock "cinder-quobyte-70ef994a-82c1-460a-b774-e787d0fbd45f" released by "delete_volume" :: held 1.439s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:10 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Created reservations ['a828fbd7-eee9-4901-a9f1-917b9ed53f5b', 'cd49f467-7aa2-4c55-aacf-56e4e99f382c', '2ed958a0-1274-4fae-9a1a-de515656198b', 'd9e1c175-2294-460e-a640-cb4a058a447f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:49:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:49:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:49:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:10 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:49:10 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:11 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.654s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:11 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:49:11 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Deleted volume successfully. Jul 05 18:49:11 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-4f3de62a-d195-4ecd-92df-be40a346ac7b tempest-ProjectReaderTests-1750246745 None] Lock "cinder-70ef994a-82c1-460a-b774-e787d0fbd45f-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:12 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:49:12 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:12 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.680s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:49:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (12b6ec55-b9a2-4f15-a4b9-31d0a2d4406d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c78156-dc59-4acc-b187-e58ede342435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c78156-dc59-4acc-b187-e58ede342435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700026753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8f5d90-4852-4858-bc0b-ee27b769fcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:49:19Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e5e9a2-7793-46e3-81dc-9cf2e439de9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e5e9a2-7793-46e3-81dc-9cf2e439de9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3bac30-a4d6-4e53-b190-14293bc0bf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e3bac30-a4d6-4e53-b190-14293bc0bf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8f5d90-4852-4858-bc0b-ee27b769fcc8', 'volume_name': 'volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f145dd81-d277-4dcd-87ee-c12d3c44c0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f145dd81-d277-4dcd-87ee-c12d3c44c0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a40098-dbcf-4f08-bc45-f52d1b1519ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:19 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Volume 2d8f5d90-4852-4858-bc0b-ee27b769fcc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8', 'volume_size': 1} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700026753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8f5d90-4852-4858-bc0b-ee27b769fcc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:49:19Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Creating volume 2d8f5d90-4852-4858-bc0b-ee27b769fcc8 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:49:19 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:49:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:19 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 1073741824 Jul 05 18:49:19 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:20 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 1073741824" returned: 0 in 0.943s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:20 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 Jul 05 18:49:20 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:21 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" returned: 0 in 0.676s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a40098-dbcf-4f08-bc45-f52d1b1519ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d54d05-6219-49d4-ad4a-960c0197e3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:21 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Volume volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 (2d8f5d90-4852-4858-bc0b-ee27b769fcc8): created successfully Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d54d05-6219-49d4-ad4a-960c0197e3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (12b6ec55-b9a2-4f15-a4b9-31d0a2d4406d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:49:21 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-faa69803-d267-4b27-bde8-911598d9323d tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot c783a09d-cc85-4cc7-bc4a-d37dedac6a1f of volume 2d8f5d90-4852-4858-bc0b-ee27b769fcc8 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fac409-439d-4c1d-af0a-accd8082b251]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:21 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 Jul 05 18:49:21 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:22 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" returned: 0 in 0.828s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:22 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f 1G Jul 05 18:49:22 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:23 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f 1G" returned: 0 in 0.846s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:23 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f Jul 05 18:49:23 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:23 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f" returned: 0 in 0.740s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:23 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f is being set with open permissions: ugo+rw Jul 05 18:49:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:24 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f Jul 05 18:49:24 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:24 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f" returned: 0 in 0.711s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:24 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=44,cinder:UPDATE=64,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:49:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:24 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.info Jul 05 18:49:24 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:25 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.info" returned: 0 in 0.691s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:25 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.info is being set with open permissions: ugo+rw Jul 05 18:49:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:25 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.info Jul 05 18:49:25 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:26 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.info" returned: 0 in 0.674s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.584s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:26 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-a131957e-d8a4-4c4b-a2c2-c669a7efe6cf tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-c783a09d-cc85-4cc7-bc4a-d37dedac6a1f-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-c783a09d-cc85-4cc7-bc4a-d37dedac6a1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-c783a09d-cc85-4cc7-bc4a-d37dedac6a1f" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-c783a09d-cc85-4cc7-bc4a-d37dedac6a1f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Deleting offline snapshot c783a09d-cc85-4cc7-bc4a-d37dedac6a1f of volume 2d8f5d90-4852-4858-bc0b-ee27b769fcc8 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] snapshot_file for this snap is: volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68bc58d-d9b6-410e-b748-02d1b1a5d54f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:26 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f Jul 05 18:49:26 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:27 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f" returned: 0 in 0.798s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:27 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:49:27 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b1a503-6eb0-40a0-8f56-ea3a72a72c60]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:27 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 Jul 05 18:49:27 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:28 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" returned: 0 in 0.831s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:28 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f Jul 05 18:49:28 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:29 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f" returned: 0 in 0.784s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:29 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f Jul 05 18:49:29 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:29 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8.c783a09d-cc85-4cc7-bc4a-d37dedac6a1f" returned: 0 in 0.675s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-c783a09d-cc85-4cc7-bc4a-d37dedac6a1f" released by "_delete_snapshot" :: held 3.199s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" released by "delete_snapshot" :: held 3.222s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:30 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=53,cinder:SELECT=51,cinder:DELETE=6,cinder:INSERT=15 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:49:30 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Created reservations ['4dbb6bec-7a6a-41fe-9c17-548e6d32f7e8', 'f82c02ce-391e-439c-88bb-0cdd08e0ba0e', '9e6d199d-8962-4b62-b30e-bf4039f33d26', 'f8f941a6-bd21-46f2-a8a7-166a2205f1ca'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:49:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Delete snapshot completed successfully. Jul 05 18:49:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-929d6090-e9d7-4771-94e0-168064322ea9 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-c783a09d-cc85-4cc7-bc4a-d37dedac6a1f-delete_snapshot" released by "delete_snapshot" :: held 3.382s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-2d8f5d90-4852-4858-bc0b-ee27b769fcc8-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-2d8f5d90-4852-4858-bc0b-ee27b769fcc8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:31 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" acquired by "delete_volume" :: waited 0.018s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:31 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[142398f9-931f-4746-a8a2-b4356ddbf53c]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:31 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 Jul 05 18:49:31 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:31 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" returned: 0 in 0.801s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:31 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:32 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8 Jul 05 18:49:32 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:32 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" returned: 0 in 0.692s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:32 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-2d8f5d90-4852-4858-bc0b-ee27b769fcc8" released by "delete_volume" :: held 1.562s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:32 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Created reservations ['89d6ddd0-a683-4b7b-9256-902c44c936b9', '224b1863-bc14-4206-bdfa-dddae21fb331', '2b768dab-613e-474a-89c2-83339467bcc5', '34ee7757-91fe-4b04-9dd9-892a4209deff'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:49:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:49:32 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:49:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:32 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:32 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:49:32 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:33 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.723s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:49:33 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Deleted volume successfully. Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-e0918588-f7df-4d57-9336-8a0caa7e6df6 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-2d8f5d90-4852-4858-bc0b-ee27b769fcc8-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (25cb2368-b73a-4c6c-bf99-e085bc32f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41d00a1-e4cc-46cb-b089-2ba40c7179c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41d00a1-e4cc-46cb-b089-2ba40c7179c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400526957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ebb2b9-a988-4479-99cb-c416cba8e3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:49:34Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8041342-65ee-49dd-846f-f5a61a59f18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8041342-65ee-49dd-846f-f5a61a59f18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d276d48-17ec-418c-976a-76054d8bfcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d276d48-17ec-418c-976a-76054d8bfcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ebb2b9-a988-4479-99cb-c416cba8e3d5', 'volume_name': 'volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a11081-5484-44b2-bf30-f0e312a49796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a11081-5484-44b2-bf30-f0e312a49796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ae3025-c88d-492f-be8d-9c872a96044f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Volume d3ebb2b9-a988-4479-99cb-c416cba8e3d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5', 'volume_size': 1} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400526957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ebb2b9-a988-4479-99cb-c416cba8e3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:49:34Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Creating volume d3ebb2b9-a988-4479-99cb-c416cba8e3d5 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:49:33 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:49:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:33 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 1073741824 Jul 05 18:49:33 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:34 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 1073741824" returned: 0 in 0.829s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:34 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 Jul 05 18:49:34 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:35 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" returned: 0 in 0.647s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:49:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ae3025-c88d-492f-be8d-9c872a96044f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498e43df-6cbb-4152-be8c-a091cf191b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Volume volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 (d3ebb2b9-a988-4479-99cb-c416cba8e3d5): created successfully Jul 05 18:49:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498e43df-6cbb-4152-be8c-a091cf191b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (25cb2368-b73a-4c6c-bf99-e085bc32f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:49:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-82a48947-2c18-455e-91d2-c7d8dd2356d9 tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:49:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:36 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot c5474cb5-0283-4ef0-8339-5894a5ea2ee4 of volume d3ebb2b9-a988-4479-99cb-c416cba8e3d5 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:49:36 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1334a83-1a4e-420e-8639-bb5d8a564b8e]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:36 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 Jul 05 18:49:36 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:37 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" returned: 0 in 0.740s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:37 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 1G Jul 05 18:49:37 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:37 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 1G" returned: 0 in 0.824s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:37 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 Jul 05 18:49:37 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:38 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4" returned: 0 in 0.717s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:38 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 is being set with open permissions: ugo+rw Jul 05 18:49:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:38 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 Jul 05 18:49:38 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:39 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4" returned: 0 in 0.644s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:39 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.info Jul 05 18:49:39 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:39 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.info" returned: 0 in 0.667s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:39 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.info is being set with open permissions: ugo+rw Jul 05 18:49:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:39 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.info Jul 05 18:49:39 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:40 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.info" returned: 0 in 0.670s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.339s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:40 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c27a54ef-09c2-46aa-abce-fad9d05c03b5 tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-c5474cb5-0283-4ef0-8339-5894a5ea2ee4-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-c5474cb5-0283-4ef0-8339-5894a5ea2ee4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-c5474cb5-0283-4ef0-8339-5894a5ea2ee4" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-c5474cb5-0283-4ef0-8339-5894a5ea2ee4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Deleting offline snapshot c5474cb5-0283-4ef0-8339-5894a5ea2ee4 of volume d3ebb2b9-a988-4479-99cb-c416cba8e3d5 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] snapshot_file for this snap is: volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[2415e5fd-f2e4-41d7-8cd8-6eabaf1ac4f1]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:41 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 Jul 05 18:49:41 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:42 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4" returned: 0 in 0.803s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:49:42 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[218bd51f-b7c9-4ae2-b52d-250730bde4c0]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:42 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 Jul 05 18:49:42 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:43 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" returned: 0 in 0.805s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:43 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:43 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 Jul 05 18:49:43 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:44 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4" returned: 0 in 0.736s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:44 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4 Jul 05 18:49:44 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:44 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:44 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5.c5474cb5-0283-4ef0-8339-5894a5ea2ee4" returned: 0 in 0.678s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-c5474cb5-0283-4ef0-8339-5894a5ea2ee4" released by "_delete_snapshot" :: held 3.116s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" released by "delete_snapshot" :: held 3.142s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:44 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Created reservations ['e86f9163-2fee-4e60-b6ee-c3ccf4eddac1', 'e938ea97-0d16-4ad8-bd2a-9653bad5e1fa', 'e82808d8-84a2-44f6-a504-68d17fac318e', 'b22a2cd9-486b-4f4c-b55d-df27c9f1886a'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:49:44 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Delete snapshot completed successfully. Jul 05 18:49:44 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-c3074596-8daa-454c-be6f-235ae6353f06 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-c5474cb5-0283-4ef0-8339-5894a5ea2ee4-delete_snapshot" released by "delete_snapshot" :: held 3.276s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-d3ebb2b9-a988-4479-99cb-c416cba8e3d5-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-d3ebb2b9-a988-4479-99cb-c416cba8e3d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:45 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:46 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddbf61c-a781-4a70-bb0f-5836c9667902]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:46 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 Jul 05 18:49:46 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:46 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" returned: 0 in 0.776s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:46 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:46 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5 Jul 05 18:49:46 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:47 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" returned: 0 in 0.655s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:47 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-d3ebb2b9-a988-4479-99cb-c416cba8e3d5" released by "delete_volume" :: held 1.484s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:47 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Created reservations ['77976354-dd6e-49dc-a39d-b11941c5518e', '63d5c2e7-e00d-4401-87ad-094c88e47c9a', 'b97b1368-a288-40a8-b336-354b8eaf58c2', '228c6b4c-eede-474f-a14d-9df1696f495e'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:49:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:49:47 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:49:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:47 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:47 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:49:47 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:48 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.676s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:49:48 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Deleted volume successfully. Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-aff6bbfa-9c66-4b14-ad87-0ea092598749 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-d3ebb2b9-a988-4479-99cb-c416cba8e3d5-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (77db1ef6-1b80-4874-ab75-8b3ce0678c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f24e152-381e-4883-bcf4-ea4b3cf0af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f24e152-381e-4883-bcf4-ea4b3cf0af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355062654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497a6c89-274c-4ed3-baca-284c8b9237a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:49:49Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e064bbf4-32e9-46b6-9e2e-2e848d82529e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e064bbf4-32e9-46b6-9e2e-2e848d82529e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8d8e29-e668-46cf-872a-20f04694b031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8d8e29-e668-46cf-872a-20f04694b031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497a6c89-274c-4ed3-baca-284c8b9237a5', 'volume_name': 'volume-497a6c89-274c-4ed3-baca-284c8b9237a5', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752ba806-c9eb-4fac-a951-85c5b8245858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752ba806-c9eb-4fac-a951-85c5b8245858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9733d05-1986-4980-ad85-62266f678ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:48 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Volume 497a6c89-274c-4ed3-baca-284c8b9237a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497a6c89-274c-4ed3-baca-284c8b9237a5', 'volume_size': 1} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355062654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497a6c89-274c-4ed3-baca-284c8b9237a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:49:49Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Creating volume 497a6c89-274c-4ed3-baca-284c8b9237a5 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:49:48 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:49:48 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:48 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 1073741824 Jul 05 18:49:48 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:49 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 1073741824" returned: 0 in 0.863s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:49 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:49 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 Jul 05 18:49:49 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:50 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5" returned: 0 in 0.656s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9733d05-1986-4980-ad85-62266f678ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497a6c89-274c-4ed3-baca-284c8b9237a5', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920f4c3f-ce2e-491a-b250-2369c918c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:49:50 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Volume volume-497a6c89-274c-4ed3-baca-284c8b9237a5 (497a6c89-274c-4ed3-baca-284c8b9237a5): created successfully Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (920f4c3f-ce2e-491a-b250-2369c918c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (77db1ef6-1b80-4874-ab75-8b3ce0678c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:49:50 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-9ef8379e-e022-40a8-a21f-86291f81c888 tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot ce831b76-0a8f-4da0-bcc2-51936ffb59e6 of volume 497a6c89-274c-4ed3-baca-284c8b9237a5 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c3dc5d-131e-4249-b9b5-3c67f84af2aa]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:50 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:50 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 Jul 05 18:49:50 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:51 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5" returned: 0 in 0.773s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:51 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:51 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 1G Jul 05 18:49:51 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:52 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 1G" returned: 0 in 0.817s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:52 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497a6c89-274c-4ed3-baca-284c8b9237a5 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:52 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497a6c89-274c-4ed3-baca-284c8b9237a5 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 Jul 05 18:49:52 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:53 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497a6c89-274c-4ed3-baca-284c8b9237a5 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6" returned: 0 in 0.689s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:53 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 is being set with open permissions: ugo+rw Jul 05 18:49:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:53 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 Jul 05 18:49:53 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:53 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6" returned: 0 in 0.694s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:53 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:53 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.info Jul 05 18:49:53 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:54 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.info" returned: 0 in 0.682s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:54 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.info is being set with open permissions: ugo+rw Jul 05 18:49:54 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:54 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.info Jul 05 18:49:54 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:55 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.info" returned: 0 in 0.638s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:55 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.373s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:49:55 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-09378a2a-c493-40db-9e7e-1d711665cc84 tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-ce831b76-0a8f-4da0-bcc2-51936ffb59e6-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-ce831b76-0a8f-4da0-bcc2-51936ffb59e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-497a6c89-274c-4ed3-baca-284c8b9237a5" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-497a6c89-274c-4ed3-baca-284c8b9237a5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-ce831b76-0a8f-4da0-bcc2-51936ffb59e6" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-ce831b76-0a8f-4da0-bcc2-51936ffb59e6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Deleting offline snapshot ce831b76-0a8f-4da0-bcc2-51936ffb59e6 of volume 497a6c89-274c-4ed3-baca-284c8b9237a5 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] snapshot_file for this snap is: volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41a9b05-fd02-49a7-a643-8fffcd8ff699]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:56 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 Jul 05 18:49:56 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:56 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6" returned: 0 in 0.766s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497a6c89-274c-4ed3-baca-284c8b9237a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432793d-0ab4-45fd-83ee-0b75ab0f6e3f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:49:56 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:57 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 Jul 05 18:49:57 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:57 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5" returned: 0 in 0.779s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:57 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:57 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 Jul 05 18:49:57 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:58 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6" returned: 0 in 0.723s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:58 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:49:58 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6 Jul 05 18:49:58 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:49:59 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 05 18:49:59 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5.ce831b76-0a8f-4da0-bcc2-51936ffb59e6" returned: 0 in 0.634s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:49:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-ce831b76-0a8f-4da0-bcc2-51936ffb59e6" released by "_delete_snapshot" :: held 2.997s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-497a6c89-274c-4ed3-baca-284c8b9237a5" released by "delete_snapshot" :: held 3.020s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:49:59 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Created reservations ['dfdcb78b-d221-423b-9662-c8c0f82a8e27', 'b42a0cc7-c5ed-4c59-a83c-1decc0c945cc', 'bf1a33ff-24e0-4b5c-aaac-077cd11ec2ff', '0dcdc4a2-740c-46ca-8afa-4ed64157d14f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:49:59 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Delete snapshot completed successfully. Jul 05 18:49:59 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-727824dd-2f17-4eeb-a37d-732edba5e5c4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-ce831b76-0a8f-4da0-bcc2-51936ffb59e6-delete_snapshot" released by "delete_snapshot" :: held 3.148s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-497a6c89-274c-4ed3-baca-284c8b9237a5-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Lock "cinder-497a6c89-274c-4ed3-baca-284c8b9237a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-497a6c89-274c-4ed3-baca-284c8b9237a5" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:00 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-497a6c89-274c-4ed3-baca-284c8b9237a5" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:00 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09ab66b-4adc-4fb2-b2b3-70c6ce070cc8]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:00 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:00 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 Jul 05 18:50:00 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:01 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5" returned: 0 in 0.762s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:01 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5 Jul 05 18:50:01 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:01 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-497a6c89-274c-4ed3-baca-284c8b9237a5" returned: 0 in 0.652s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-497a6c89-274c-4ed3-baca-284c8b9237a5" released by "delete_volume" :: held 1.474s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Created reservations ['1a274b10-ed33-4d1d-9fb8-23cd85980e2a', 'e61af2cb-185f-4984-95bb-776331dca0fd', 'f8f87e12-529f-43de-a4ff-c84ba15c2eb9', '95df77b6-28ca-485e-920c-f19f0b2d7d98'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:01 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:01 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:50:01 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:02 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.675s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:50:02 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Deleted volume successfully. Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-7306eb48-ffb5-4064-a72a-cd5f211760bb tempest-ProjectMemberTests-1841497491 None] Lock "cinder-497a6c89-274c-4ed3-baca-284c8b9237a5-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (3b6bf498-1cf3-4a69-a3b8-6f8d42f9637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca604124-10db-4adc-92db-d38ea1679a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca604124-10db-4adc-92db-d38ea1679a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-653290786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad96ac8a-697d-43dd-bdca-981810cf5d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:50:03Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fb75a3-e330-4bef-b098-37e8ee020fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fb75a3-e330-4bef-b098-37e8ee020fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8cc625-f981-484a-a58b-329346696de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8cc625-f981-484a-a58b-329346696de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad96ac8a-697d-43dd-bdca-981810cf5d0f', 'volume_name': 'volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbbc513-32e3-454e-bfa0-a720f8a5a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:02 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbbc513-32e3-454e-bfa0-a720f8a5a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2caaa03d-48a2-449e-84e2-a4a174c155ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:03 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Volume ad96ac8a-697d-43dd-bdca-981810cf5d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f', 'volume_size': 1} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-653290786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad96ac8a-697d-43dd-bdca-981810cf5d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:50:03Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Creating volume ad96ac8a-697d-43dd-bdca-981810cf5d0f {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:50:03 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:03 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f 1073741824 Jul 05 18:50:03 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:03 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f 1073741824" returned: 0 in 0.855s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:03 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:03 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f Jul 05 18:50:03 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:04 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f" returned: 0 in 0.674s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:04 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:50:04 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2caaa03d-48a2-449e-84e2-a4a174c155ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded9c13c-6748-42ca-8b12-278992e0eebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:04 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Volume volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f (ad96ac8a-697d-43dd-bdca-981810cf5d0f): created successfully Jul 05 18:50:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded9c13c-6748-42ca-8b12-278992e0eebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:04 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (3b6bf498-1cf3-4a69-a3b8-6f8d42f9637b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:50:04 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-99550d63-7456-4cc9-845f-16051152f592 tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:50:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:05 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot 57210812-e834-4c63-b195-ed18359208b2 of volume ad96ac8a-697d-43dd-bdca-981810cf5d0f {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:50:05 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3326fc-9c8f-4b5c-84cb-1a5d98ce303f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:05 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f Jul 05 18:50:05 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:05 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f" returned: 0 in 0.751s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:05 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:05 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 1G Jul 05 18:50:05 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:06 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 1G" returned: 0 in 0.780s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:06 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:06 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 Jul 05 18:50:06 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:07 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2" returned: 0 in 0.698s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:07 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 is being set with open permissions: ugo+rw Jul 05 18:50:07 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:07 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 Jul 05 18:50:07 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:08 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2" returned: 0 in 0.649s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:08 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.info Jul 05 18:50:08 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:08 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.info" returned: 0 in 0.639s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:08 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.info is being set with open permissions: ugo+rw Jul 05 18:50:08 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:08 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.info Jul 05 18:50:08 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:09 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.info" returned: 0 in 0.650s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:09 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.243s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:09 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-328ca5f4-f371-4906-856c-6d581f1dfa90 tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-57210812-e834-4c63-b195-ed18359208b2-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-57210812-e834-4c63-b195-ed18359208b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-ad96ac8a-697d-43dd-bdca-981810cf5d0f" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-ad96ac8a-697d-43dd-bdca-981810cf5d0f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-57210812-e834-4c63-b195-ed18359208b2" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-57210812-e834-4c63-b195-ed18359208b2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Deleting offline snapshot 57210812-e834-4c63-b195-ed18359208b2 of volume ad96ac8a-697d-43dd-bdca-981810cf5d0f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] snapshot_file for this snap is: volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6e1ecc-cf75-4998-b9e9-9e5ec5387ce3]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:10 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:10 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 Jul 05 18:50:10 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:11 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2" returned: 0 in 0.765s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:11 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:50:11 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c4300-3631-40c9-9e72-8e3b73875e1a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:11 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:11 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f Jul 05 18:50:11 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:12 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f" returned: 0 in 0.765s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:12 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 Jul 05 18:50:12 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:12 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:50:12 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:12 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2" returned: 0 in 0.745s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:12 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2 Jul 05 18:50:12 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:12 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.681s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG oslo_service.periodic_task [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] Running periodic task VolumeManager._thread_info {{(pid=86664) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread count: 29 {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 05 18:50:12 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-654eb9a7-41c2-4ef0-93d8-236b0352c135 None None] thread info: [<_MainThread(MainThread, started 130083626848384)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86664) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 05 18:50:13 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:13 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f.57210812-e834-4c63-b195-ed18359208b2" returned: 0 in 0.652s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-57210812-e834-4c63-b195-ed18359208b2" released by "_delete_snapshot" :: held 3.029s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-ad96ac8a-697d-43dd-bdca-981810cf5d0f" released by "delete_snapshot" :: held 3.052s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:13 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Created reservations ['963ce569-e985-44b6-960a-30b2ff020c25', 'aab8e0d3-298e-4eb9-90cc-272e2911d552', '6997f320-997f-46f5-a129-926b4982e97f', '0d379c2b-9889-4ee2-82df-a6453ee2dd74'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:50:13 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Delete snapshot completed successfully. Jul 05 18:50:13 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-cbc90361-c7bb-4294-9024-3e951876cef4 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-57210812-e834-4c63-b195-ed18359208b2-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-ad96ac8a-697d-43dd-bdca-981810cf5d0f-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-ad96ac8a-697d-43dd-bdca-981810cf5d0f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-ad96ac8a-697d-43dd-bdca-981810cf5d0f" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:14 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-ad96ac8a-697d-43dd-bdca-981810cf5d0f" acquired by "delete_volume" :: waited 0.013s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:14 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e43516c-af43-4fcf-8b13-d51c5604f853]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:14 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:14 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f Jul 05 18:50:14 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:15 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f" returned: 0 in 0.737s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:15 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:15 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f Jul 05 18:50:15 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:16 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ad96ac8a-697d-43dd-bdca-981810cf5d0f" returned: 0 in 0.625s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-ad96ac8a-697d-43dd-bdca-981810cf5d0f" released by "delete_volume" :: held 1.417s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Created reservations ['6e3b28d8-1803-4ca1-8c75-6048f9425717', '5edb6a5e-b4b4-421a-aa7d-d515509e19d9', 'bdff4405-7feb-4f73-8d5b-3147e15f3dc9', 'c8c3e60c-645e-41cc-a8fb-e7edd06403f7'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:16 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:50:16 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:16 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.657s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:50:16 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Deleted volume successfully. Jul 05 18:50:16 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-eecaff1d-9e4a-47e2-8444-fd8892b9c577 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-ad96ac8a-697d-43dd-bdca-981810cf5d0f-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (4f47c8e6-8974-42b4-bf18-4433388e2e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a762df36-01ff-444a-a07e-ec430fe8ba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a762df36-01ff-444a-a07e-ec430fe8ba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1208846814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:50:17Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b50791f-3410-4870-a66b-a08aa41af7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b50791f-3410-4870-a66b-a08aa41af7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4795e5-1242-41f4-a33b-963914f3053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4795e5-1242-41f4-a33b-963914f3053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9', 'volume_name': 'volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec240da-0508-458c-b269-ab23ab31b04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec240da-0508-458c-b269-ab23ab31b04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea92000e-93e3-4aca-b6ce-5f08d78e1f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:17 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Volume bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9', 'volume_size': 1} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1208846814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6f83dc4af42d1995e10d0abe5444e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:50:17Z,use_quota=True,user_id='54a6cbeb03ae41ee89c597796ab5892f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Creating volume bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:50:17 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:50:17 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:17 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 1073741824 Jul 05 18:50:17 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:18 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 1073741824" returned: 0 in 0.806s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:18 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 Jul 05 18:50:18 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:18 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" returned: 0 in 0.629s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:18 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:50:18 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea92000e-93e3-4aca-b6ce-5f08d78e1f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521ef790-639f-47ea-8ad5-f1cb5e7294f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:18 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Volume volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 (bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9): created successfully Jul 05 18:50:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521ef790-639f-47ea-8ad5-f1cb5e7294f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:18 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Flow 'volume_create_manager' (4f47c8e6-8974-42b4-bf18-4433388e2e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:50:18 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d9770064-ef29-432d-8559-e16565f22c43 tempest-ProjectMemberTests-1841497491 None] Created volume successfully. Jul 05 18:50:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:19 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Creating offline snapshot cde9f38c-7d0d-42a0-ac54-36476742932f of volume bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 {{(pid=86664) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 05 18:50:19 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447bc7a-c945-4a02-8cac-009042f60688]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:19 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:19 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 Jul 05 18:50:19 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:20 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" returned: 0 in 0.735s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:20 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f 1G {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:20 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f 1G Jul 05 18:50:20 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:21 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f 1G" returned: 0 in 0.774s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:21 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f Jul 05 18:50:21 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:21 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 -F qcow2 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f" returned: 0 in 0.673s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:21 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f is being set with open permissions: ugo+rw Jul 05 18:50:21 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:21 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f Jul 05 18:50:21 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:22 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f" returned: 0 in 0.645s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:22 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:22 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.info Jul 05 18:50:22 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:23 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.info" returned: 0 in 0.656s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:23 devstack cinder-volume[86664]: WARNING cinder.volume.drivers.remotefs [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.info is being set with open permissions: ugo+rw Jul 05 18:50:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.info {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:23 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.info Jul 05 18:50:23 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:23 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.info" returned: 0 in 0.629s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:23 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.193s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:23 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-d109e80a-2558-4ebb-9c66-01729b5f58a2 tempest-ProjectMemberTests-1841497491 None] Create snapshot completed successfully Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-cde9f38c-7d0d-42a0-ac54-36476742932f-delete_snapshot" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-cde9f38c-7d0d-42a0-ac54-36476742932f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" by "delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-cde9f38c-7d0d-42a0-ac54-36476742932f" by "_delete_snapshot" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-cde9f38c-7d0d-42a0-ac54-36476742932f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Deleting offline snapshot cde9f38c-7d0d-42a0-ac54-36476742932f of volume bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] snapshot_file for this snap is: volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f {{(pid=86664) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c6caf-cdc3-4214-9864-4e662831eaf4]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:24 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:24 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f Jul 05 18:50:24 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:25 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f" returned: 0 in 0.752s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:25 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86664) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 05 18:50:25 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fcf3b1-a965-4c5a-b269-dc6d46472823]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:25 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:25 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 Jul 05 18:50:25 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:26 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" returned: 0 in 0.745s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:26 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:26 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f Jul 05 18:50:26 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:27 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f" returned: 0 in 0.713s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:27 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f Jul 05 18:50:27 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:27 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9.cde9f38c-7d0d-42a0-ac54-36476742932f" returned: 0 in 0.630s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-cde9f38c-7d0d-42a0-ac54-36476742932f" released by "_delete_snapshot" :: held 2.923s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" released by "delete_snapshot" :: held 2.943s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:UPDATE=68,cinder:DELETE=6,cinder:SELECT=63,cinder:INSERT=18 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Created reservations ['df171b52-0ad7-4902-b536-31543179ce79', 'f4168ef5-b9a9-4062-8b1a-416cd75738e7', '9e064242-706f-4a65-b324-3e6dd1a471e4', 'f7f7904b-f961-4361-af91-bff549015e8b'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:50:27 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Delete snapshot completed successfully. Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-5e17a618-a670-4478-8bbc-0fd37d694b96 tempest-ProjectMemberTests-1841497491 None] Lock "cinder-cde9f38c-7d0d-42a0-ac54-36476742932f-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:27 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Lock "cinder-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Acquiring lock "cinder-quobyte-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:28 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" acquired by "delete_volume" :: waited 0.016s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:28 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b1e149-e0c7-47ef-a0c6-5982787e2350]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:28 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 Jul 05 18:50:28 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:28 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" returned: 0 in 0.758s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:28 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:28 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9 Jul 05 18:50:28 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:29 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" returned: 0 in 0.630s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:29 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Lock "cinder-quobyte-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9" released by "delete_volume" :: held 1.444s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:29 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Created reservations ['0f98d6bd-1f48-4b35-b71e-aba9625ec227', 'aa34ced1-2557-4433-8cc9-3d0e50f222ad', 'ad2f2f65-338d-459f-8959-8d466305e434', 'bb54626c-0441-49a9-92d8-17e9871bcd49'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:50:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:29 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:29 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:29 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:50:29 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:30 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:30 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.636s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:30 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:50:30 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Deleted volume successfully. Jul 05 18:50:30 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:INSERT=28,cinder:UPDATE=92,cinder:SELECT=59,cinder:DELETE=8 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:50:30 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-32c31727-d7c5-4b5d-8391-16582fe1680d tempest-ProjectMemberTests-1841497491 None] Lock "cinder-bcfb3ab2-9f4a-4d13-aba6-ce168e8331b9-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Flow 'volume_create_manager' (1e084767-f94b-40c5-bbb3-9f25edb0079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5682518-560a-493c-a1a1-cb55ca7e31a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5682518-560a-493c-a1a1-cb55ca7e31a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435471135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdf504d-b1ff-4530-8204-9d8714babf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da5c7a7ffe349dca17d7e1ffe7f0907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:50:34Z,use_quota=True,user_id='f3b4d6c22cc2478e8922de671fc5270d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35da0c7d-98be-4de4-bc51-d413a4a555ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35da0c7d-98be-4de4-bc51-d413a4a555ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230ebe0c-9640-4a8f-9af8-c704a01240af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230ebe0c-9640-4a8f-9af8-c704a01240af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cdf504d-b1ff-4530-8204-9d8714babf9e', 'volume_name': 'volume-2cdf504d-b1ff-4530-8204-9d8714babf9e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97adeb0c-5230-4383-b6d6-93e2cf4b3cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97adeb0c-5230-4383-b6d6-93e2cf4b3cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f2d112-7739-434e-bd8f-d5c36e32741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:33 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Volume 2cdf504d-b1ff-4530-8204-9d8714babf9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cdf504d-b1ff-4530-8204-9d8714babf9e', 'volume_size': 1} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435471135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cdf504d-b1ff-4530-8204-9d8714babf9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da5c7a7ffe349dca17d7e1ffe7f0907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:50:34Z,use_quota=True,user_id='f3b4d6c22cc2478e8922de671fc5270d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Creating volume 2cdf504d-b1ff-4530-8204-9d8714babf9e {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:50:33 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:50:33 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:33 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e 1073741824 Jul 05 18:50:33 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:34 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e 1073741824" returned: 0 in 0.810s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:34 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:34 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e Jul 05 18:50:34 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:35 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e" returned: 0 in 0.644s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f2d112-7739-434e-bd8f-d5c36e32741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cdf504d-b1ff-4530-8204-9d8714babf9e', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca1bf4f-716e-4a51-8f9f-cb1d97a9d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:35 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Volume volume-2cdf504d-b1ff-4530-8204-9d8714babf9e (2cdf504d-b1ff-4530-8204-9d8714babf9e): created successfully Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca1bf4f-716e-4a51-8f9f-cb1d97a9d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Flow 'volume_create_manager' (1e084767-f94b-40c5-bbb3-9f25edb0079b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:50:35 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-5aa085c4-6187-41eb-81a8-6b751615a952 tempest-ProjectReaderTests-655934777 None] Created volume successfully. Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Acquiring lock "cinder-2cdf504d-b1ff-4530-8204-9d8714babf9e-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Lock "cinder-2cdf504d-b1ff-4530-8204-9d8714babf9e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Acquiring lock "cinder-quobyte-2cdf504d-b1ff-4530-8204-9d8714babf9e" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Lock "cinder-quobyte-2cdf504d-b1ff-4530-8204-9d8714babf9e" acquired by "delete_volume" :: waited 0.015s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c46591e-f2e9-4bd4-b50a-951e5728978a]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:35 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:36 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e Jul 05 18:50:36 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:36 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e" returned: 0 in 0.762s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:36 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:36 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e Jul 05 18:50:36 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:37 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-2cdf504d-b1ff-4530-8204-9d8714babf9e" returned: 0 in 0.638s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:37 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Lock "cinder-quobyte-2cdf504d-b1ff-4530-8204-9d8714babf9e" released by "delete_volume" :: held 1.436s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:37 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Created reservations ['c34521c0-f1b4-4286-b055-b12e3d1eddae', 'd5bab30d-d12b-44f0-a68f-f5622cf3b811', '600fd5c8-8ade-4e0c-8dd1-03ae94dd418f', '4e5269e4-c9f8-4e1f-9525-5f942b842a5f'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:50:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:37 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:37 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:37 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:50:37 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:38 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.639s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:50:38 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Deleted volume successfully. Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-0525570d-a31c-4e76-a2b7-5555d8bc1f25 tempest-ProjectReaderTests-655934777 None] Lock "cinder-2cdf504d-b1ff-4530-8204-9d8714babf9e-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.flows.manager.create_volume [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86664) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Flow 'volume_create_manager' (299b2fbd-bb80-4804-9b7d-1223c2eda234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd107f10-90b5-414e-8f18-c124bf88f446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd107f10-90b5-414e-8f18-c124bf88f446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367671577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7eda68-124f-4f4c-81ed-379e3a2d7c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da5c7a7ffe349dca17d7e1ffe7f0907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:50:38Z,use_quota=True,user_id='f3b4d6c22cc2478e8922de671fc5270d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c00c3d-6a05-4a47-8692-5567b908be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c00c3d-6a05-4a47-8692-5567b908be5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faa3dae-2898-4928-836e-dd1c51a298a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4faa3dae-2898-4928-836e-dd1c51a298a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7eda68-124f-4f4c-81ed-379e3a2d7c6b', 'volume_name': 'volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c858f2-3b3a-4e94-bab7-bbbbc0024c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c858f2-3b3a-4e94-bab7-bbbbc0024c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3efa7f0-7738-46dd-8031-c62f0d61543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:38 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Volume ea7eda68-124f-4f4c-81ed-379e3a2d7c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b', 'volume_size': 1} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-05T16:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-367671577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7eda68-124f-4f4c-81ed-379e3a2d7c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da5c7a7ffe349dca17d7e1ffe7f0907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-05T16:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-05T16:50:38Z,use_quota=True,user_id='f3b4d6c22cc2478e8922de671fc5270d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a),volume_type_id=c7c80b8a-cbf8-4679-a2bf-eb0365ebe74a)}" {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.remotefs [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Creating volume ea7eda68-124f-4f4c-81ed-379e3a2d7c6b {{(pid=86664) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Selected osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae as target Quobyte volume. {{(pid=86664) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 05 18:50:38 devstack cinder-volume[86664]: INFO cinder.volume.drivers.remotefs [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] casted to osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae Jul 05 18:50:38 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b 1073741824 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:38 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b 1073741824 Jul 05 18:50:38 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:39 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b 1073741824" returned: 0 in 0.801s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:39 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:39 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b Jul 05 18:50:39 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:40 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b" returned: 0 in 0.622s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'} {{(pid=86664) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3efa7f0-7738-46dd-8031-c62f0d61543c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b', 'volume_size': 1}' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f5862a-4b4c-4525-a229-6227ef0f6510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 05 18:50:40 devstack cinder-volume[86664]: INFO cinder.volume.flows.manager.create_volume [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Volume volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b (ea7eda68-124f-4f4c-81ed-379e3a2d7c6b): created successfully Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f5862a-4b4c-4525-a229-6227ef0f6510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86664) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Flow 'volume_create_manager' (299b2fbd-bb80-4804-9b7d-1223c2eda234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86664) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 05 18:50:40 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-846bb6e0-8207-4144-bf76-83f968efdc48 tempest-ProjectReaderTests-655934777 None] Created volume successfully. Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Acquiring lock "cinder-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b-delete_volume" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Lock "cinder-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Acquiring lock "cinder-quobyte-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b" by "delete_volume" {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Lock "cinder-quobyte-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b" acquired by "delete_volume" :: waited 0.014s {{(pid=86664) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG oslo.privsep.daemon [-] privsep: reply[66020a6c-c905-4a6b-97f4-0a6c8829b53f]: (4, 'qcow2') {{(pid=87679) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 05 18:50:40 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:40 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b Jul 05 18:50:40 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:41 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b" returned: 0 in 0.755s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:41 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:41 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b Jul 05 18:50:41 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:42 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805/volume-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b" returned: 0 in 0.637s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Lock "cinder-quobyte-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b" released by "delete_volume" :: held 1.430s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG cinder.quota [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Created reservations ['58a89dfd-4a7a-443c-b452-da6b379c4043', 'e080b5c6-2b86-497c-b064-c4eb6012df7c', '2bfa6e0c-94ef-4c90-ad5e-350c9b0e96d0', '8b2bf240-89b9-4613-82be-a8ac4cda3529'] {{(pid=86664) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae': None} {{(pid=86664) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG cinder.volume.drivers.quobyte [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2b6a005e-69bc-4866-aeee-cbb1b2a4e0ae'] {{(pid=86664) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.lockutils [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86664) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 05 18:50:42 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805 Jul 05 18:50:42 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 05 18:50:42 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG oslo_concurrency.processutils [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a60559c543e3d56094d49450cfe97805" returned: 0 in 0.649s {{(pid=86664) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG cinder.manager [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Notifying Schedulers of capabilities ... {{(pid=86664) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 05 18:50:42 devstack cinder-volume[86664]: INFO cinder.volume.manager [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Deleted volume successfully. Jul 05 18:50:42 devstack cinder-volume[86664]: DEBUG cinder.coordination [None req-19f742bd-c7df-4344-89ae-18b4e3d08be0 tempest-ProjectReaderTests-655934777 None] Lock "cinder-ea7eda68-124f-4f4c-81ed-379e3a2d7c6b-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=86664) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 05 18:50:52 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 05 18:50:52 devstack cinder-volume[86664]: DEBUG dbcounter [-] [86664] Writing DB stats cinder:SELECT=14,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86664) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}